-- Logs begin at Sun 2022-02-20 19:07:27 UTC, end at Sun 2022-02-20 20:21:12 UTC. -- Feb 20 19:54:30.213681 dv-cinder-830085-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 20 19:54:30.223488 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 20 19:54:30.226083 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Feb 20 19:54:30 2022] *** Feb 20 19:54:30.226083 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 20 19:54:30.226083 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 20 19:54:30.226083 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: nodename: dv-cinder-830085-1-iscsi Feb 20 19:54:30.226083 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: machine: x86_64 Feb 20 19:54:30.226083 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: clock source: unix Feb 20 19:54:30.226083 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: pcre jit disabled Feb 20 19:54:30.226083 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: detected number of CPU cores: 4 Feb 20 19:54:30.226083 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: current working directory: / Feb 20 19:54:30.226083 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: detected binary path: /usr/bin/uwsgi-core Feb 20 19:54:30.226814 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: your processes number limit is 47680 Feb 20 19:54:30.226814 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: your memory page size is 4096 bytes Feb 20 19:54:30.226814 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: detected max file descriptor number: 2048 Feb 20 19:54:30.226814 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: lock engine: pthread robust mutexes Feb 20 19:54:30.226814 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: thunder lock: enabled Feb 20 19:54:30.226814 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 20 19:54:30.226814 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 20 19:54:30.271389 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: Python main interpreter initialized at 0x557bb2f7b9c0 Feb 20 19:54:30.271389 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: python threads support enabled Feb 20 19:54:30.271389 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: your server socket listen backlog is limited to 100 connections Feb 20 19:54:30.271389 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: your mercy for graceful operations on workers is 90 seconds Feb 20 19:54:30.271723 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: mapped 403077 bytes (393 KB) for 2 cores Feb 20 19:54:30.271808 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: *** Operational MODE: preforking *** Feb 20 19:54:30.272044 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: *** uWSGI is running in multiple interpreter mode *** Feb 20 19:54:30.272044 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: spawned uWSGI master process (pid: 102407) Feb 20 19:54:30.272229 dv-cinder-830085-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 20 19:54:30.273274 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: spawned uWSGI worker 1 (pid: 102408, cores: 1) Feb 20 19:54:30.273649 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: spawned uWSGI worker 2 (pid: 102409, cores: 1) Feb 20 19:54:30.273860 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 20 19:54:32.133157 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 20 19:54:32.133157 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: from cryptography.utils import int_from_bytes Feb 20 19:54:32.133787 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 20 19:54:32.133787 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: from cryptography.utils import int_from_bytes Feb 20 19:54:32.138539 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 20 19:54:32.138539 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: from cryptography.utils import int_from_bytes Feb 20 19:54:32.139046 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 20 19:54:32.139046 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: from cryptography.utils import int_from_bytes Feb 20 19:54:34.703072 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 20 19:54:34.703643 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 20 19:54:34.703822 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 20 19:54:34.704108 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 20 19:54:34.704471 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 20 19:54:34.704572 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 20 19:54:34.704655 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 20 19:54:34.704794 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.704878 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 20 19:54:34.705150 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.705262 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 20 19:54:34.705474 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.705568 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 20 19:54:34.705794 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.705881 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.706121 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.706219 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.706429 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.706513 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.706751 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.706836 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.707070 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.707156 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.707395 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.707490 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.707655 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.707786 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.707971 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.708116 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.708295 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830085-1-iscsi {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.708453 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.708615 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.708710 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.708923 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.709042 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.709259 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.709369 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830085-1-iscsi {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.709615 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.709708 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.709928 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.710051 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.710311 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.710424 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.710654 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.710747 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.710977 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.711189 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.711338 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.711653 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.711788 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.712106 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.712797 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.712918 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.713209 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.713396 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.713578 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.713801 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.713948 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.714164 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.714345 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.714548 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.714671 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.714921 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.715050 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.715250 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.715417 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.715607 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.715738 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.716035 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830085-1-iscsi {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.716124 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.716370 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.716490 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.716679 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.716802 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830085-1-iscsi {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.716994 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.717100 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.717700 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.717792 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.718017 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.718124 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.718333 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.718483 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.718658 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.718775 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.718985 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.719127 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.719303 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.719635 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.719727 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.719957 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.720284 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.720380 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.720607 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.720790 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.720955 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.721193 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.721343 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.721490 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.721639 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.721802 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.721952 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.722121 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.722271 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.722436 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.722585 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.722747 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.722899 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.723061 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.723199 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.723367 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.723511 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.723693 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.723825 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.723990 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.724124 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.724263 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.724395 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.724544 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.724689 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.724792 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.724916 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.725323 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.725512 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.725855 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.725951 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.726119 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.726379 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.726464 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.726706 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.726949 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.727120 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.727267 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.727412 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.727612 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.727767 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.727957 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.728105 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.728328 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.728416 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.728652 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.728740 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.728971 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.729056 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.729319 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.729406 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.729639 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.729727 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.729958 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.730069 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.730286 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.730379 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.730599 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.730684 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.730912 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.731007 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.731243 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.731327 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.731560 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.731645 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.731875 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.731960 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.732196 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.732293 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.732518 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.732604 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.732829 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.732915 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.733156 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.733265 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.733466 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.733553 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.733787 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.733885 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.734126 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.734244 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.734434 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.734529 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.734685 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.734771 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.734987 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.735081 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.735294 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.735380 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.735613 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.735700 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.735920 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.736013 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.736227 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.736323 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.736534 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.736621 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.736835 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.736921 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.737162 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.737250 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.737474 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.737568 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.737780 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.737866 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.738086 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.738179 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.738393 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.738477 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.738696 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.738781 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.739003 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.739090 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.739318 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.739411 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.739620 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.739706 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.739936 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.740022 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.740251 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.740346 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.740557 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.740642 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.740865 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.740951 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.741198 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.741352 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.741508 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.741606 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.741827 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.741913 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.742134 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.742231 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.742439 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.742525 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.742753 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.742836 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.743058 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.743233 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.743412 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.743530 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.743895 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.744046 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.744131 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.744224 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.744417 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.744504 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.744735 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.744827 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.745037 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.745149 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.745370 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.745468 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.745687 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.745775 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.745993 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.746089 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.746299 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.746385 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.746601 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.746686 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.746905 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.746991 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.747209 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.747293 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.747512 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.747597 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.747815 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.747908 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.748118 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.748203 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.748417 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.748502 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.748730 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.748817 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.749045 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.749198 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.749389 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.749474 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.749698 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.749785 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.750002 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.750086 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.750319 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.750415 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.750655 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.750741 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.750987 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.751071 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.751304 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.751399 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.751619 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.751713 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.751948 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 19:54:34.752033 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.752277 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.752372 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.752597 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.752682 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.752910 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.753002 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.753248 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.753353 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.753578 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.753673 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.753893 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.753980 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.754206 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.754305 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.754519 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.754604 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.754838 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.754923 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.755156 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.755243 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.755489 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.755594 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.755805 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.755898 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.756123 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.756218 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.756441 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.756537 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.756753 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.756840 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.757070 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.757187 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.757422 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.757508 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.757743 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.757828 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.758054 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.758145 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.758379 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.758464 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.758706 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.758791 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.759559 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.759687 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.759887 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.760154 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.760253 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.760480 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.760568 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.760796 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.760883 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.761130 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.761220 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.761451 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.761539 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.761777 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.761871 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.762112 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.762198 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.762428 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.762516 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.762752 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.762878 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.763067 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.763221 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.763383 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.763563 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.763696 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.763888 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.764032 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.764219 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.764307 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.764542 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.764628 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.764865 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.764951 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.765211 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.765301 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.765570 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.765670 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.765856 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.765943 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.766190 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.766278 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.766503 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.766589 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.766816 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.766901 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.767122 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.767218 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.767428 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.767515 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.767733 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.767832 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.768042 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.768128 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.768348 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.768440 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.768664 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.768762 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.768978 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.769065 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.769311 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.769398 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.769630 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.769728 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.769944 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.770030 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.770252 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.770337 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.770563 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.770659 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.770873 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.770960 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.771179 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.771273 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.771493 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.771587 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.771805 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.771891 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.772112 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.772205 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.772433 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.772519 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.772743 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.772829 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.773048 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.773164 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.773392 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.773479 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.773697 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.773782 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.774001 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.774135 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.774316 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.774403 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.775231 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.775365 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.775565 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.775671 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.775936 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.776042 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.776248 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.776335 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.776573 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.776668 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.776887 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.776978 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.777227 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.777318 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.777549 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.777650 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.777872 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.777958 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.778176 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.778261 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.778503 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.778600 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.778822 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.778907 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.779135 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.779219 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.779439 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.779526 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.779752 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.779845 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.780055 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.780141 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.780361 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.780449 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.780665 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.780750 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.780973 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.781060 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.781301 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.781393 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.781605 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.781691 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.781908 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.782001 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.782211 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.782298 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.782514 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.782601 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.782837 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.782923 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.783145 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.783232 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.783448 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.783535 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.783751 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.783846 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.784053 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.784138 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.784383 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.784524 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.784686 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.784828 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.784995 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.785169 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.785334 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.785476 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.785647 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.785747 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.785997 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.786139 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.786307 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.786454 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.786622 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.786762 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.786933 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.787076 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.787245 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.787381 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.787558 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.787704 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.787869 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.788007 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.788191 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.788335 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.788488 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.788625 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.788808 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.788945 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.789140 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.789287 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.789466 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.789600 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.789782 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.789922 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.790151 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.790318 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.790519 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.790675 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.790844 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.790978 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.791180 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.791327 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.791501 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.791633 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.791832 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.791965 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.792148 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.792290 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.792473 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.792623 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.792788 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.792921 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.793139 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.793292 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.793428 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.793561 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.793733 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.793872 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.794047 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.794194 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.794369 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.794514 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.794680 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.794813 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.794999 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.795146 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.795309 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.795445 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.795633 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.795769 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.795999 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.796198 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.796339 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.796473 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.796609 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.796753 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.796896 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.797039 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.797203 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.797344 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.797476 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.797617 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.797788 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.797923 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.798102 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.798234 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.798423 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.798556 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.798735 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.798873 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.799044 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.799178 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.799355 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.799495 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.799662 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.799821 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.799976 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.800108 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.800286 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.800428 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.800603 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.800752 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.800914 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.801047 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.801248 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.801397 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.801554 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.801692 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.801869 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.802005 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.802180 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.802325 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.802468 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.802614 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.802774 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.802910 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.803085 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.803224 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.803405 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.803561 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.803713 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.803920 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.804087 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.804229 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.804369 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.804506 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.804655 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.804792 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.804944 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.805102 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.805251 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.805389 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.805527 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.805665 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.805892 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.806056 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.806227 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.806480 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.806626 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.806788 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.806929 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.807073 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.807220 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.807360 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.807499 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.807645 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.807792 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.807932 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.808070 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.808216 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.808362 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.808510 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.808668 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.808807 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.808946 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.809123 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.809270 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.809594 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.809728 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.809916 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.810227 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.810364 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.810592 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.810809 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.811043 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.811276 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.811451 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.811589 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.811734 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.811734 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.811990 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.812126 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.812335 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.812471 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.812647 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.812893 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.813037 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.813277 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.813495 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.813633 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.814072 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.814217 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.814480 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.814624 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.815043 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.815203 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.815497 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.815630 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.815847 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.816183 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.816330 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.816517 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.816774 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.816908 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.817196 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.817418 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.817555 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.817851 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.817941 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.818273 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.818598 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.818851 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.819003 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.819225 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.819462 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.819596 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.819814 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.819953 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.820154 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.820297 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.820467 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.820605 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.820778 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.820915 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.821105 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.821252 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.821963 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.822197 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.822387 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.822563 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.822704 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.822872 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.823009 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.823194 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.823401 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.823538 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.823674 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.823818 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.823964 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.824107 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.824245 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.824409 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.824546 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.824722 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.824867 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.825028 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.825192 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.825367 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.825521 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.825674 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.825815 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.825989 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.826126 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.826307 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.826440 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.826625 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.826769 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.826954 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.827085 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.827272 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.827413 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.827594 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.827731 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.827903 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.828048 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.828296 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.828565 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.828715 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.828901 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.829202 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.829425 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.829656 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.829879 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.829879 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.830306 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.830447 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.830605 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.830741 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.830883 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.831026 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.831162 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.831395 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.831604 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.831847 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.832118 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.832377 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.832574 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.832730 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.832730 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.833007 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.833184 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.833184 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.833451 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.833589 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.833761 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.833915 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.834091 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.834321 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.834467 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.834693 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.834864 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.835010 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.835306 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.835452 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.835614 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.835917 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.836061 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.836214 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.836462 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.836608 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.838030 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.838251 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.838433 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.838433 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.838723 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.839175 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.839753 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.840144 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.840470 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.840785 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.841122 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.841458 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.841783 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.842064 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.842427 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.842648 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.842798 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.842957 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.843120 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.843267 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.843469 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.843576 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.843893 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.843987 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.844195 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.844380 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.844505 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.844749 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.844863 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.845119 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.845216 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.845442 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.845530 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.845767 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.845854 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.846080 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.846167 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.846387 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.846483 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.846695 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.846791 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.847002 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.847141 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.847351 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.847451 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.847659 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.847754 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.847981 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.848076 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.848314 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.848403 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.848635 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.848722 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.848956 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.849051 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.849299 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.849388 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.849626 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.849722 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.849950 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.850053 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.850259 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.850352 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.850583 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.850670 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.850898 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.850994 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.851214 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.851299 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.851519 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.851605 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.851826 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.851915 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.852141 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.852225 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.852451 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.852569 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.853336 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.853547 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.853852 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.853949 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.854270 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.854438 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.854607 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.854921 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.855036 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.855239 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.855556 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.855656 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.855879 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.856024 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.856282 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.856446 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.856609 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.856781 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.856931 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.857038 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.857251 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.857452 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.857549 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.857872 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.858058 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.858190 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.858504 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.858666 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.858827 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.858979 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.859176 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.859313 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.859484 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.859633 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.859811 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.859965 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.860104 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.860238 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.860416 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.860570 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.860718 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.860846 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.861021 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.861208 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.861348 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.861492 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.861644 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.861779 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.862088 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.862229 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.862399 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.862536 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.862714 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.862856 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.863022 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.863160 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.863337 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.863483 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.863632 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.863762 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.863958 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.864101 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.864274 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.864433 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.864579 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.864809 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.865000 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.865342 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.865489 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.865724 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.865910 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.866044 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.866487 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.866618 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.866797 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.867114 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.867269 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.867441 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.867657 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.867789 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.867999 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.868141 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.868918 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.869079 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.869321 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.869413 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.869611 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.869709 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.869932 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.870018 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.870257 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.870353 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.870586 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.870682 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.870913 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.871000 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.871239 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.871324 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.871566 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.871653 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.871893 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.871979 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.872221 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.872307 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.872551 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.872639 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.872875 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.872968 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.873285 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.873426 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.873538 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.873625 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.873810 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.873897 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.874134 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.874230 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.874460 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.874551 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.874773 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.874859 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.875090 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.875186 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.875396 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.875484 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.875718 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.875804 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.876037 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.876133 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.876352 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.876445 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.876668 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.876753 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.877081 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.877221 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.877435 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.877524 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.877749 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.878057 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.878155 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.878389 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.878664 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.878752 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.878999 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.879152 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.879307 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.879461 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.879612 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.879778 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.879930 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.880115 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.880280 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.880493 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.880580 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.880919 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.881266 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.881654 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.881793 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.881884 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.881977 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.882174 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.882319 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.882497 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.882808 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.882905 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.883136 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.883391 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.883479 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.883931 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.884134 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.884373 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.884796 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.885115 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.885319 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.885837 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.886024 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.886340 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.886603 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.886783 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.886928 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.887120 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.887246 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.887467 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.887555 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.887863 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.887955 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.888217 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.888314 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.888534 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.888620 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.888862 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.888970 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.889226 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.889336 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.889565 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.889668 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.889883 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.890127 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.890644 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.890745 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.891176 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.891619 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.891718 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.892188 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.892409 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.892640 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.892749 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.892991 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.893079 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.893369 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.893470 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.893716 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.893885 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.894234 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.894736 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.894962 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.895299 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.895394 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.895618 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.895854 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.895942 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.896243 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.896473 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.896561 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.896860 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.897024 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.897197 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.897496 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.897595 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.897826 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.897912 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.898155 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.898250 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.898471 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.898569 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.898780 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.898879 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.899092 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.899180 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.899451 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.899616 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.899797 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.899910 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.900193 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.900298 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.900513 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.900603 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.900850 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.900938 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.901194 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.901287 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.901524 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.901614 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.901840 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.901927 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.902161 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.902260 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.902479 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.902575 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.902796 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.902883 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.903118 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.903213 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.903437 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.903530 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.903754 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.903848 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.904074 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.904171 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.904394 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.904482 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.904711 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.904800 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.905031 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.905150 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.905375 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.905469 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.905698 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.905786 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.906021 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.906265 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.906353 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.906597 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.906683 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.906914 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.907011 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.907230 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.907318 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.907545 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.907645 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.907867 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.908117 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.908220 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.908484 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.908740 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.908839 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.909114 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.909376 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.909466 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.909751 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.909989 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.910078 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.910388 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.910561 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.910728 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.911048 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.911142 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.911366 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.911683 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.911779 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.912000 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.912275 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.912364 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.912667 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.912833 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.912974 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.913319 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.913434 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.913638 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.913956 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.914052 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.914270 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.914496 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.914603 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.914839 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.915553 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.915876 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.916071 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.916232 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.916525 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.916621 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.916845 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.916935 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.917188 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.917278 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.917512 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.917615 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.917846 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.917946 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.918184 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.918277 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.918507 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.918604 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.918823 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.918910 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.919140 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.919227 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.919601 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.919791 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.920129 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.920447 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.920545 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.920781 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.920888 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.921167 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.921364 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.921519 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.921677 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.921829 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.922008 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.922101 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.922519 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.922618 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.922833 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.923136 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.923303 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.923446 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.923609 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.923762 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.923914 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.924069 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.924232 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.924351 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.924653 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.924741 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.925037 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.925316 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.925472 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.925672 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.925830 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.925998 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.926242 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.926378 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.926592 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.926915 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.927004 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.927247 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.927470 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.927567 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.927885 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.927997 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.928197 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.928523 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.928622 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.928833 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.929163 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.929485 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.929580 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.929799 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.930057 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.930167 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.930400 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.930609 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.931360 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.931651 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.931751 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.932049 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.932272 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.932369 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.932665 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.932829 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.932998 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.933331 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.933438 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.933642 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.933951 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.934037 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.934268 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.934505 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.934592 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.934870 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.935065 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.935235 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.935475 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.935610 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.935794 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.936102 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.936240 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.936415 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.936682 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.936775 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.937023 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.937126 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.937370 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.937828 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.938202 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.938456 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.938557 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.938816 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.938923 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.939120 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.939215 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.939438 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.939535 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.939758 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.939865 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.940074 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.940172 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.940388 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.940503 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.940702 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.940833 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.941048 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.941193 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.941389 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.941528 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.941940 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.942042 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.942283 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.942369 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.942613 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.942701 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.942942 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.943098 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.943285 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.943428 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.943593 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.943740 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.943946 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.944141 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.944277 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.944611 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.944699 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.945049 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.945256 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.945456 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.945587 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.945783 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.945872 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.946109 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.946198 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.946484 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.946930 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.947082 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.947404 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.947504 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.947730 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.947825 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.948052 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.948137 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.948376 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.948548 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.948690 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.948827 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.948999 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.949159 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.949343 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.949442 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.949667 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.950018 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.950345 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.950674 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.950851 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.951003 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.951156 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.951324 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.951480 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.951625 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.951900 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.952210 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.952531 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.952751 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.952970 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.953318 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.953480 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.953630 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.953768 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.953768 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.954200 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.954517 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.954839 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.955164 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.955479 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.955803 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.956134 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.956450 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.956775 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.957120 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.957443 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.957796 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.958014 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.958107 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.958439 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.958668 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.958762 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.959047 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.959211 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.959358 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.959512 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.959658 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.959808 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.959960 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.960289 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.960428 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.960606 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.960719 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.960932 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.961044 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.961271 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.961389 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.961594 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.961740 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.962450 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.962661 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.962787 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.962993 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.963137 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.963339 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.963428 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.963668 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.963759 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.963995 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.964090 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.964330 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.964424 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.964641 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.964730 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.964954 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.965063 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.965290 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.965601 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.965743 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.965896 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.966134 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.966349 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.966476 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.966807 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.966924 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.967398 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.967655 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.967862 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.968010 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.968212 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.968318 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.968542 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.968689 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.968868 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.968958 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.969217 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.969312 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.969550 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.969638 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.969872 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.969978 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.970201 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.970329 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.970518 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.970612 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.970836 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.970948 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.971153 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.971387 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.971476 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.971775 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.971981 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.972105 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.972444 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.972606 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.972817 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.972973 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.973173 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.973348 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.973499 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.973602 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.973912 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.974125 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.974260 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.974561 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.974779 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.974951 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.975104 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.975267 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.975436 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.975592 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.975733 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 20 19:54:34.975822 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.976378 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.976905 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.977279 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.977667 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.978543 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.978891 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.979227 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.979802 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.980160 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.980500 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.980856 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.981232 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.981559 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.981882 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.982204 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.982545 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.982965 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.983395 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.983726 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.984053 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.985342 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.985684 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.986034 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.986353 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.986683 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.987013 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.987344 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.987678 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.988037 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.988377 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.988716 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.989048 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.989409 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.989736 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.990280 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.990631 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.990968 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.991314 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.991651 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.991983 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.992304 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.992745 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.993074 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.993945 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.994282 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.994604 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.994947 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.995377 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.995711 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.996045 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.997431 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.997772 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.998136 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.999348 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:34.999699 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.000030 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.001955 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG oslo_db.sqlalchemy.engines [None req-29da171c-87a9-4c90-ac98-c723010eb971 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 20 19:54:35.005295 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.005874 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.006234 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.006604 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.006974 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.007392 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.007748 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.008091 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.008436 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.008770 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.010043 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.010290 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.010633 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.010964 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.011318 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.011652 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.012033 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.012576 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.013065 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.013424 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.013756 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.014153 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.014673 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.015012 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.015358 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.015697 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.016039 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.016374 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.016704 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.017050 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.017464 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.018042 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.018665 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.019137 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.019473 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.019812 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.020278 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.020931 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.021428 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.021781 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.022204 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.022873 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.023328 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.023699 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.024049 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.024385 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.024746 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.025074 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 19:54:35.025355 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 20 19:54:35.057797 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG oslo_db.sqlalchemy.engines [None req-8c6352da-3f1b-4721-884e-f714b8bae602 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 20 19:54:35.066962 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.context [None req-29da171c-87a9-4c90-ac98-c723010eb971 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),84b2375e-72b1-4ebf-b9cd-f9882b4f07ae(cell1) {{(pid=102408) load_cells /opt/stack/nova/nova/context.py:464}} Feb 20 19:54:35.071428 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG oslo_concurrency.lockutils [None req-29da171c-87a9-4c90-ac98-c723010eb971 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 19:54:35.073546 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG oslo_concurrency.lockutils [None req-29da171c-87a9-4c90-ac98-c723010eb971 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 19:54:35.074359 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG oslo_concurrency.lockutils [None req-29da171c-87a9-4c90-ac98-c723010eb971 None None] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 19:54:35.076278 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG oslo_concurrency.lockutils [None req-29da171c-87a9-4c90-ac98-c723010eb971 None None] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 19:54:35.086772 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG oslo_db.sqlalchemy.engines [None req-29da171c-87a9-4c90-ac98-c723010eb971 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 20 19:54:35.090250 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG oslo_db.sqlalchemy.engines [None req-29da171c-87a9-4c90-ac98-c723010eb971 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 20 19:54:35.126132 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.context [None req-8c6352da-3f1b-4721-884e-f714b8bae602 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),84b2375e-72b1-4ebf-b9cd-f9882b4f07ae(cell1) {{(pid=102409) load_cells /opt/stack/nova/nova/context.py:464}} Feb 20 19:54:35.130529 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG oslo_concurrency.lockutils [None req-8c6352da-3f1b-4721-884e-f714b8bae602 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 19:54:35.132124 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG oslo_concurrency.lockutils [None req-8c6352da-3f1b-4721-884e-f714b8bae602 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 19:54:35.132945 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG oslo_concurrency.lockutils [None req-8c6352da-3f1b-4721-884e-f714b8bae602 None None] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 19:54:35.136007 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG oslo_concurrency.lockutils [None req-8c6352da-3f1b-4721-884e-f714b8bae602 None None] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 19:54:35.148635 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG oslo_db.sqlalchemy.engines [None req-8c6352da-3f1b-4721-884e-f714b8bae602 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 20 19:54:35.151207 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG oslo_db.sqlalchemy.engines [None req-8c6352da-3f1b-4721-884e-f714b8bae602 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 20 19:54:35.290860 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG oslo_db.sqlalchemy.engines [None req-29da171c-87a9-4c90-ac98-c723010eb971 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 20 19:54:35.344234 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG oslo_db.sqlalchemy.engines [None req-8c6352da-3f1b-4721-884e-f714b8bae602 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 20 19:54:35.744575 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: WARNING keystonemiddleware.auth_token [None req-29da171c-87a9-4c90-ac98-c723010eb971 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 20 19:54:35.751285 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: WARNING keystonemiddleware.auth_token [None req-29da171c-87a9-4c90-ac98-c723010eb971 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 20 19:54:35.751771 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: WARNING keystonemiddleware.auth_token [None req-8c6352da-3f1b-4721-884e-f714b8bae602 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 20 19:54:35.758351 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: WARNING keystonemiddleware.auth_token [None req-8c6352da-3f1b-4721-884e-f714b8bae602 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 20 19:54:36.103359 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: WARNING keystonemiddleware.auth_token [None req-8c6352da-3f1b-4721-884e-f714b8bae602 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 20 19:54:36.108427 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: WARNING keystonemiddleware.auth_token [None req-8c6352da-3f1b-4721-884e-f714b8bae602 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 20 19:54:36.109213 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: WARNING keystonemiddleware.auth_token [None req-29da171c-87a9-4c90-ac98-c723010eb971 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 20 19:54:36.113788 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557bb2f7b9c0 pid: 102409 (default app) Feb 20 19:54:36.114402 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: WARNING keystonemiddleware.auth_token [None req-29da171c-87a9-4c90-ac98-c723010eb971 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 20 19:54:36.115827 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-8c6352da-3f1b-4721-884e-f714b8bae602 None None] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:54:36.116965 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-8c6352da-3f1b-4721-884e-f714b8bae602 None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001681 Feb 20 19:54:36.117397 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Sun Feb 20 19:54:36 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 19:54:36.120028 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557bb2f7b9c0 pid: 102408 (default app) Feb 20 19:56:00.528596 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-8c6352da-3f1b-4721-884e-f714b8bae602 None None] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:00.530292 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-8c6352da-3f1b-4721-884e-f714b8bae602 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002107 Feb 20 19:56:00.530878 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 930 bytes} [Sun Feb 20 19:56:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 19:56:00.966206 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-04c174cd-dac2-4f5e-a340-6d5837ead5e5 admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:00.995858 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-04c174cd-dac2-4f5e-a340-6d5837ead5e5 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.458352 Feb 20 19:56:00.996753 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1291 bytes} [Sun Feb 20 19:56:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 19:56:03.389506 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-8c6352da-3f1b-4721-884e-f714b8bae602 None None] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:03.390537 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-8c6352da-3f1b-4721-884e-f714b8bae602 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Feb 20 19:56:03.390932 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 930 bytes} [Sun Feb 20 19:56:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 19:56:03.452777 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-339df81d-bdaa-49b2-83ff-d48a5219b5ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "ram": 256, "os-flavor-access:is_public": true, "id": "c1", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 19:56:03.471437 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 19:56:03.471437 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: warnings.warn(msg) Feb 20 19:56:03.573150 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-339df81d-bdaa-49b2-83ff-d48a5219b5ed admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.175998 Feb 20 19:56:03.574089 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1282 bytes} [Sun Feb 20 19:56:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 20 19:56:03.797516 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-f3c385f3-7b20-4451-a115-0678db5a8b80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 19:56:03.799885 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 19:56:03.799885 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: warnings.warn(msg) Feb 20 19:56:03.924341 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-f3c385f3-7b20-4451-a115-0678db5a8b80 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.342209 Feb 20 19:56:03.924748 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1335 bytes} [Sun Feb 20 19:56:03 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 19:56:06.399435 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-339df81d-bdaa-49b2-83ff-d48a5219b5ed admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:06.400480 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-339df81d-bdaa-49b2-83ff-d48a5219b5ed admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002272 Feb 20 19:56:06.401383 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 930 bytes} [Sun Feb 20 19:56:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 19:56:06.528828 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-04bc62b0-a6b5-46de-96c0-3afce209a127 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "name": "ds512M", "disk": 5, "vcpus": 1, "id": "d1"}} {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 19:56:06.547907 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 19:56:06.547907 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: warnings.warn(msg) Feb 20 19:56:06.663657 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-04bc62b0-a6b5-46de-96c0-3afce209a127 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.255694 Feb 20 19:56:06.664547 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1282 bytes} [Sun Feb 20 19:56:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 20 19:56:06.675866 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-e7e66709-a3e2-4b84-8961-bf51b9212de1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 19:56:06.677639 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 19:56:06.677639 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: warnings.warn(msg) Feb 20 19:56:06.795483 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-e7e66709-a3e2-4b84-8961-bf51b9212de1 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.123209 Feb 20 19:56:06.803373 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1335 bytes} [Sun Feb 20 19:56:06 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 19:56:09.246510 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-04bc62b0-a6b5-46de-96c0-3afce209a127 admin admin] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:09.247566 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-04bc62b0-a6b5-46de-96c0-3afce209a127 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Feb 20 19:56:09.247917 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 930 bytes} [Sun Feb 20 19:56:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 19:56:09.308403 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-40476ce8-ff04-4e79-94b4-11eec4cbd672 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "vcpus": 1, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 19:56:09.384389 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-40476ce8-ff04-4e79-94b4-11eec4cbd672 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.130298 Feb 20 19:56:09.385106 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1282 bytes} [Sun Feb 20 19:56:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 20 19:56:09.397121 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-8dd12c6c-490b-4942-beca-707079d79bbd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 19:56:09.489110 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-8dd12c6c-490b-4942-beca-707079d79bbd admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095823 Feb 20 19:56:09.499668 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1335 bytes} [Sun Feb 20 19:56:09 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 19:56:11.847488 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-40476ce8-ff04-4e79-94b4-11eec4cbd672 admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:11.851294 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-40476ce8-ff04-4e79-94b4-11eec4cbd672 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Feb 20 19:56:11.851294 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 930 bytes} [Sun Feb 20 19:56:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 19:56:11.911445 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-4e0b5756-8769-4edf-ac8e-f1393e682c34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 19:56:11.989048 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-4e0b5756-8769-4edf-ac8e-f1393e682c34 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.133911 Feb 20 19:56:11.989611 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1282 bytes} [Sun Feb 20 19:56:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 20 19:56:12.001412 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-94e943ab-f017-4b1e-b615-09034c8df346 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 19:56:12.089926 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-94e943ab-f017-4b1e-b615-09034c8df346 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092112 Feb 20 19:56:12.090523 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1335 bytes} [Sun Feb 20 19:56:11 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 19:56:14.492941 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-4e0b5756-8769-4edf-ac8e-f1393e682c34 admin admin] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:14.493972 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-4e0b5756-8769-4edf-ac8e-f1393e682c34 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Feb 20 19:56:14.494372 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 930 bytes} [Sun Feb 20 19:56:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 19:56:14.556031 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-ec894c77-57dc-4e55-ad22-39765687ddcf admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d4", "name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "disk": 20}} {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 19:56:14.641312 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-ec894c77-57dc-4e55-ad22-39765687ddcf admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140930 Feb 20 19:56:14.641979 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1282 bytes} [Sun Feb 20 19:56:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 20 19:56:14.653884 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-669e1243-97f0-4d09-a454-0953f359ce0a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 19:56:14.723864 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-669e1243-97f0-4d09-a454-0953f359ce0a admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073529 Feb 20 19:56:14.724372 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1335 bytes} [Sun Feb 20 19:56:14 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 19:56:17.200229 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-ec894c77-57dc-4e55-ad22-39765687ddcf admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:17.201307 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-ec894c77-57dc-4e55-ad22-39765687ddcf admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Feb 20 19:56:17.201711 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 930 bytes} [Sun Feb 20 19:56:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 19:56:17.261241 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-8626a832-26f2-4899-9ee0-f73c842dfce9 admin admin] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:17.284431 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-8626a832-26f2-4899-9ee0-f73c842dfce9 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076783 Feb 20 19:56:17.284977 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1291 bytes} [Sun Feb 20 19:56:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 19:56:19.685018 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-ec894c77-57dc-4e55-ad22-39765687ddcf admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:19.686084 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-ec894c77-57dc-4e55-ad22-39765687ddcf admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Feb 20 19:56:19.686501 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 930 bytes} [Sun Feb 20 19:56:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 19:56:19.746296 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-8a74b22d-de77-4b78-b602-93339516f357 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "1", "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 19:56:19.855229 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-8a74b22d-de77-4b78-b602-93339516f357 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.162852 Feb 20 19:56:19.855786 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1282 bytes} [Sun Feb 20 19:56:19 2022] POST /compute/v2.1/flavors => generated 402 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 20 19:56:19.870534 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-558b2cc0-8eff-49d2-acf4-26a432182845 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 19:56:19.953749 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-558b2cc0-8eff-49d2-acf4-26a432182845 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087600 Feb 20 19:56:19.954398 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1332 bytes} [Sun Feb 20 19:56:19 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 19:56:22.851102 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-8a74b22d-de77-4b78-b602-93339516f357 admin admin] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:22.852150 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-8a74b22d-de77-4b78-b602-93339516f357 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001704 Feb 20 19:56:22.852559 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 930 bytes} [Sun Feb 20 19:56:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 19:56:22.911399 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-95adefff-0427-4be0-8343-79e060ae70e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "id": "2", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 19:56:23.065638 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-95adefff-0427-4be0-8343-79e060ae70e4 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.206803 Feb 20 19:56:23.066129 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1282 bytes} [Sun Feb 20 19:56:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 20 19:56:23.078269 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-6334eacf-5684-4342-8f1a-64c0fb75d6ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 19:56:23.183649 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-6334eacf-5684-4342-8f1a-64c0fb75d6ed admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109043 Feb 20 19:56:23.184231 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1332 bytes} [Sun Feb 20 19:56:23 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 19:56:25.523275 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-95adefff-0427-4be0-8343-79e060ae70e4 admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:25.524225 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-95adefff-0427-4be0-8343-79e060ae70e4 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002055 Feb 20 19:56:25.524640 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 930 bytes} [Sun Feb 20 19:56:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 19:56:25.584894 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-cb1efa87-d4f3-4737-ba97-1a99a92d7b02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "id": "3", "vcpus": 2, "rxtx_factor": 1.0, "disk": 40, "name": "m1.medium"}} {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 19:56:25.657380 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-cb1efa87-d4f3-4737-ba97-1a99a92d7b02 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.126893 Feb 20 19:56:25.657930 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1282 bytes} [Sun Feb 20 19:56:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 20 19:56:25.669552 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-afea0d81-a580-4fb4-a284-92a95b677063 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 19:56:25.751976 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-afea0d81-a580-4fb4-a284-92a95b677063 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086003 Feb 20 19:56:25.752553 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1332 bytes} [Sun Feb 20 19:56:25 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 19:56:28.247711 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-cb1efa87-d4f3-4737-ba97-1a99a92d7b02 admin admin] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:28.248712 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-cb1efa87-d4f3-4737-ba97-1a99a92d7b02 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Feb 20 19:56:28.249150 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 930 bytes} [Sun Feb 20 19:56:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 19:56:28.320383 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-0dd26c09-e394-42bf-8150-b06016f979c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large", "swap": 0, "ram": 8192, "disk": 80}} {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 19:56:28.549524 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-0dd26c09-e394-42bf-8150-b06016f979c3 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.294055 Feb 20 19:56:28.550206 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1282 bytes} [Sun Feb 20 19:56:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 20 19:56:28.561917 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-dc550708-ebd9-49d4-90c0-9d29c0a7a4f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 19:56:28.641813 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-dc550708-ebd9-49d4-90c0-9d29c0a7a4f1 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083597 Feb 20 19:56:28.642711 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1332 bytes} [Sun Feb 20 19:56:28 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 19:56:31.059748 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-0dd26c09-e394-42bf-8150-b06016f979c3 admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:31.060756 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-0dd26c09-e394-42bf-8150-b06016f979c3 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Feb 20 19:56:31.065744 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 930 bytes} [Sun Feb 20 19:56:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 19:56:31.126947 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-13677531-76d7-41df-a369-33c8af770908 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "id": "5", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8}} {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 19:56:31.194365 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-13677531-76d7-41df-a369-33c8af770908 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.127116 Feb 20 19:56:31.195447 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1282 bytes} [Sun Feb 20 19:56:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 20 19:56:31.207471 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-dad174b1-be01-49b4-8cd1-a964455965d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 19:56:31.278945 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-dad174b1-be01-49b4-8cd1-a964455965d0 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074530 Feb 20 19:56:31.279904 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1332 bytes} [Sun Feb 20 19:56:31 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 19:56:53.060315 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-13677531-76d7-41df-a369-33c8af770908 admin admin] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:53.061338 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-13677531-76d7-41df-a369-33c8af770908 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Feb 20 19:56:53.061730 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 930 bytes} [Sun Feb 20 19:56:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 19:56:53.118970 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-66e2b3b7-6755-4336-b995-26685c0c90bc admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:53.136193 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-66e2b3b7-6755-4336-b995-26685c0c90bc admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068694 Feb 20 19:56:53.136792 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1291 bytes} [Sun Feb 20 19:56:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 19:56:54.511827 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-13677531-76d7-41df-a369-33c8af770908 admin admin] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:54.512817 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-13677531-76d7-41df-a369-33c8af770908 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Feb 20 19:56:54.513238 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Sun Feb 20 19:56:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 19:56:54.719347 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-09714ef1-a4c5-4513-bd40-7667abf73d5b admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:54.724916 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.wsgi [None req-09714ef1-a4c5-4513-bd40-7667abf73d5b admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 20 19:56:54.725538 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-09714ef1-a4c5-4513-bd40-7667abf73d5b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 19:56:54.726332 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-09714ef1-a4c5-4513-bd40-7667abf73d5b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058739 Feb 20 19:56:54.726844 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Sun Feb 20 19:56:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 20 19:56:54.736032 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-9f82fed9-d21b-4dd1-879a-e42a622019b8 admin admin] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:54.757058 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-9f82fed9-d21b-4dd1-879a-e42a622019b8 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024538 Feb 20 19:56:54.757605 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Sun Feb 20 19:56:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 19:56:54.766857 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-b0fc4f2b-f720-4c65-8312-53908ce54dfa admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:54.787942 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-b0fc4f2b-f720-4c65-8312-53908ce54dfa admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024507 Feb 20 19:56:54.788452 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Sun Feb 20 19:56:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 19:56:54.797516 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-40cb61f1-eb5e-4da2-8638-446bbadbd95c admin admin] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:54.803297 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.wsgi [None req-40cb61f1-eb5e-4da2-8638-446bbadbd95c admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 20 19:56:54.803852 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-40cb61f1-eb5e-4da2-8638-446bbadbd95c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 19:56:54.804631 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-40cb61f1-eb5e-4da2-8638-446bbadbd95c admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010726 Feb 20 19:56:54.805138 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Sun Feb 20 19:56:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 20 19:56:56.070655 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-b0fc4f2b-f720-4c65-8312-53908ce54dfa admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:56.071683 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-b0fc4f2b-f720-4c65-8312-53908ce54dfa admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Feb 20 19:56:56.072080 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Sun Feb 20 19:56:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 19:56:56.261610 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-3b575bc5-cfac-468b-b95a-d921d96c0887 admin admin] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:56.266779 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.wsgi [None req-3b575bc5-cfac-468b-b95a-d921d96c0887 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 20 19:56:56.267336 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-3b575bc5-cfac-468b-b95a-d921d96c0887 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 19:56:56.268116 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-3b575bc5-cfac-468b-b95a-d921d96c0887 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059094 Feb 20 19:56:56.268619 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Sun Feb 20 19:56:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 20 19:56:56.278408 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-96d7c974-1688-435e-81f5-28d0cc9f2838 admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:56.291551 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-96d7c974-1688-435e-81f5-28d0cc9f2838 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016580 Feb 20 19:56:56.292021 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Sun Feb 20 19:56:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 19:56:56.301315 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-b1151307-2f2a-491d-beb9-7c7cbfe5b2f4 admin admin] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:56.315248 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-b1151307-2f2a-491d-beb9-7c7cbfe5b2f4 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017392 Feb 20 19:56:56.318554 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Sun Feb 20 19:56:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 19:56:56.326628 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-fab32ff5-780e-4844-bf3f-c618796382b6 admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:56.331912 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.wsgi [None req-fab32ff5-780e-4844-bf3f-c618796382b6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 20 19:56:56.332471 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-fab32ff5-780e-4844-bf3f-c618796382b6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 19:56:56.333344 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-fab32ff5-780e-4844-bf3f-c618796382b6 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010253 Feb 20 19:56:56.334677 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Sun Feb 20 19:56:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 20 19:56:57.613203 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-b1151307-2f2a-491d-beb9-7c7cbfe5b2f4 admin admin] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:57.614202 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-b1151307-2f2a-491d-beb9-7c7cbfe5b2f4 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Feb 20 19:56:57.614594 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Sun Feb 20 19:56:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 19:56:57.801831 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-53b06984-6b1a-428b-925b-374fd6b1d9b0 admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:57.807584 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.wsgi [None req-53b06984-6b1a-428b-925b-374fd6b1d9b0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 20 19:56:57.808152 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-53b06984-6b1a-428b-925b-374fd6b1d9b0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 19:56:57.808934 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-53b06984-6b1a-428b-925b-374fd6b1d9b0 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057319 Feb 20 19:56:57.809472 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Sun Feb 20 19:56:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 20 19:56:57.819990 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-21f08aca-5290-407f-bc96-a5bd1a1aaa31 admin admin] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:57.833321 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-21f08aca-5290-407f-bc96-a5bd1a1aaa31 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018072 Feb 20 19:56:57.834183 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Sun Feb 20 19:56:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 19:56:57.845706 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-5fda42f0-e966-4010-8e71-fb625f704727 admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:57.859211 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-5fda42f0-e966-4010-8e71-fb625f704727 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019011 Feb 20 19:56:57.859740 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Sun Feb 20 19:56:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 19:56:57.869660 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-9db00cb3-aee0-426e-ab63-1554c75779cb admin admin] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:57.874847 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.wsgi [None req-9db00cb3-aee0-426e-ab63-1554c75779cb admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 20 19:56:57.875403 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-9db00cb3-aee0-426e-ab63-1554c75779cb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 19:56:57.876174 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-9db00cb3-aee0-426e-ab63-1554c75779cb admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010032 Feb 20 19:56:57.876657 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Sun Feb 20 19:56:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 20 19:56:59.164716 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-5fda42f0-e966-4010-8e71-fb625f704727 admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:56:59.165743 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-5fda42f0-e966-4010-8e71-fb625f704727 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Feb 20 19:56:59.166138 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Sun Feb 20 19:56:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 19:56:59.361706 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-59d02deb-cb44-4967-88cf-ffc8619a3cf6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 19:56:59.432490 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-59d02deb-cb44-4967-88cf-ffc8619a3cf6 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.123277 Feb 20 19:56:59.433047 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Sun Feb 20 19:56:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 20 19:57:00.696695 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-5fda42f0-e966-4010-8e71-fb625f704727 admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:57:00.697712 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-5fda42f0-e966-4010-8e71-fb625f704727 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Feb 20 19:57:00.698108 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Sun Feb 20 19:57:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 19:57:00.890018 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-8fdb636f-b713-43b0-84fe-9e7cce0a0b71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 19:57:00.995425 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-8fdb636f-b713-43b0-84fe-9e7cce0a0b71 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.157464 Feb 20 19:57:00.995891 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Sun Feb 20 19:57:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 20 19:57:02.292162 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-5fda42f0-e966-4010-8e71-fb625f704727 admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:57:02.293193 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-5fda42f0-e966-4010-8e71-fb625f704727 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Feb 20 19:57:02.293606 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Sun Feb 20 19:57:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 19:57:02.492696 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-107236bb-42fa-40fa-bce3-251acdabc48c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 19:57:02.575545 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-107236bb-42fa-40fa-bce3-251acdabc48c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.138856 Feb 20 19:57:02.576081 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Sun Feb 20 19:57:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 20 19:57:03.867070 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-5fda42f0-e966-4010-8e71-fb625f704727 admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:57:03.868125 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-5fda42f0-e966-4010-8e71-fb625f704727 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Feb 20 19:57:03.868521 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Sun Feb 20 19:57:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 19:57:04.062053 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-669434ed-c101-4609-ab7a-b229b9e761cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 19:57:04.133704 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-669434ed-c101-4609-ab7a-b229b9e761cd admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.122577 Feb 20 19:57:04.134520 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Sun Feb 20 19:57:04 2022] POST /compute/v2.1/flavors => generated 409 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 20 19:57:05.399842 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-5fda42f0-e966-4010-8e71-fb625f704727 admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:57:05.400842 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-5fda42f0-e966-4010-8e71-fb625f704727 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Feb 20 19:57:05.401283 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Sun Feb 20 19:57:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 19:57:05.587391 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-0276b719-053f-41b0-80d4-f9761bfb6522 admin admin] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:57:05.606493 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-0276b719-053f-41b0-80d4-f9761bfb6522 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070199 Feb 20 19:57:05.607018 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Sun Feb 20 19:57:05 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 19:57:56.647810 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-5fda42f0-e966-4010-8e71-fb625f704727 admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:57:56.648818 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-5fda42f0-e966-4010-8e71-fb625f704727 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Feb 20 19:57:56.649245 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 930 bytes} [Sun Feb 20 19:57:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 19:57:56.707135 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-5354bd0c-d741-4dbf-bbd0-6111e5046858 admin admin] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:57:56.726993 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-5354bd0c-d741-4dbf-bbd0-6111e5046858 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071959 Feb 20 19:57:56.727533 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1291 bytes} [Sun Feb 20 19:57:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 19:57:56.749198 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-a8f9e960-d556-4a73-923c-570d9caa0849 admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:57:56.756903 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-a8f9e960-d556-4a73-923c-570d9caa0849 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011226 Feb 20 19:57:56.757462 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1282 bytes} [Sun Feb 20 19:57:56 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 19:57:56.768689 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-82964945-517a-4398-bc4c-3cab8d6190ae admin admin] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:57:56.776245 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-82964945-517a-4398-bc4c-3cab8d6190ae admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011479 Feb 20 19:57:56.776762 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1285 bytes} [Sun Feb 20 19:57:56 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 19:57:56.788215 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-d2fdb3a2-6ca4-4eb6-9b21-f5053b3865ba admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:57:56.795677 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-d2fdb3a2-6ca4-4eb6-9b21-f5053b3865ba admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011582 Feb 20 19:57:56.796196 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1285 bytes} [Sun Feb 20 19:57:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 19:57:56.806984 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-97b75b13-c88d-4fe5-be6e-72586a966498 admin admin] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 19:57:56.814734 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-97b75b13-c88d-4fe5-be6e-72586a966498 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011197 Feb 20 19:57:56.815665 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1282 bytes} [Sun Feb 20 19:57:56 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:00:00.093136 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-6c8e24e9-bc0e-47f4-be4d-5d33596ada56 tempest-verify_tempest_config-589839999 tempest-verify_tempest_config-589839999-project] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:00:00.095241 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-6c8e24e9-bc0e-47f4-be4d-5d33596ada56 tempest-verify_tempest_config-589839999 tempest-verify_tempest_config-589839999-project] 10.222.0.60 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.109629 Feb 20 20:00:00.095773 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 34/69] 10.222.0.60 () {58 vars in 1133 bytes} [Sun Feb 20 19:59:59 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 20 20:01:42.831259 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-97b75b13-c88d-4fe5-be6e-72586a966498 admin admin] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:01:42.832480 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-97b75b13-c88d-4fe5-be6e-72586a966498 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Feb 20 20:01:42.833079 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 36/70] 10.222.0.60 () {56 vars in 1074 bytes} [Sun Feb 20 20:01:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:01:43.087445 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-a20673e0-63cd-4803-a19e-0f950a6df2a5 admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:01:43.088605 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:01:43.088605 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: warnings.warn(msg) Feb 20 20:01:43.090205 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG oslo_concurrency.lockutils [None req-a20673e0-63cd-4803-a19e-0f950a6df2a5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:01:43.090677 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG oslo_concurrency.lockutils [None req-a20673e0-63cd-4803-a19e-0f950a6df2a5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:01:43.091731 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG oslo_concurrency.lockutils [None req-a20673e0-63cd-4803-a19e-0f950a6df2a5 admin admin] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:01:43.092160 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG oslo_concurrency.lockutils [None req-a20673e0-63cd-4803-a19e-0f950a6df2a5 admin admin] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:01:43.126234 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-a20673e0-63cd-4803-a19e-0f950a6df2a5 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.149359 Feb 20 20:01:43.126819 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 35/71] 10.222.0.60 () {60 vars in 1193 bytes} [Sun Feb 20 20:01:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 20 20:01:44.428906 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-97b75b13-c88d-4fe5-be6e-72586a966498 admin admin] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:01:44.429950 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-97b75b13-c88d-4fe5-be6e-72586a966498 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Feb 20 20:01:44.430348 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 37/72] 10.222.0.60 () {56 vars in 1074 bytes} [Sun Feb 20 20:01:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:01:44.624996 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-ebf0a980-4848-4059-87c5-ef11a87c0ede admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:01:44.626209 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:01:44.626209 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: warnings.warn(msg) Feb 20 20:01:44.627773 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG oslo_concurrency.lockutils [None req-ebf0a980-4848-4059-87c5-ef11a87c0ede admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:01:44.628223 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG oslo_concurrency.lockutils [None req-ebf0a980-4848-4059-87c5-ef11a87c0ede admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:01:44.629781 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG oslo_concurrency.lockutils [None req-ebf0a980-4848-4059-87c5-ef11a87c0ede admin admin] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:01:44.630222 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG oslo_concurrency.lockutils [None req-ebf0a980-4848-4059-87c5-ef11a87c0ede admin admin] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:01:44.649048 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-ebf0a980-4848-4059-87c5-ef11a87c0ede admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074366 Feb 20 20:01:44.649573 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 36/73] 10.222.0.60 () {60 vars in 1193 bytes} [Sun Feb 20 20:01:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 20 20:01:56.360040 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-97b75b13-c88d-4fe5-be6e-72586a966498 admin admin] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:01:56.361027 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-97b75b13-c88d-4fe5-be6e-72586a966498 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Feb 20 20:01:56.361456 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 38/74] 10.222.0.60 () {56 vars in 1074 bytes} [Sun Feb 20 20:01:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:01:56.551879 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-3f72248d-6d8e-42c6-a836-8a32b38aa417 admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:01:56.553028 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:01:56.553028 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: warnings.warn(msg) Feb 20 20:01:56.554633 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG oslo_concurrency.lockutils [None req-3f72248d-6d8e-42c6-a836-8a32b38aa417 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:01:56.555095 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG oslo_concurrency.lockutils [None req-3f72248d-6d8e-42c6-a836-8a32b38aa417 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:01:56.555881 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG oslo_concurrency.lockutils [None req-3f72248d-6d8e-42c6-a836-8a32b38aa417 admin admin] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:01:56.556312 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG oslo_concurrency.lockutils [None req-3f72248d-6d8e-42c6-a836-8a32b38aa417 admin admin] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:01:56.582136 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-3f72248d-6d8e-42c6-a836-8a32b38aa417 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080110 Feb 20 20:01:56.582136 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 37/75] 10.222.0.60 () {60 vars in 1193 bytes} [Sun Feb 20 20:01:56 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:01:57.894791 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: DEBUG nova.api.openstack.wsgi [None req-97b75b13-c88d-4fe5-be6e-72586a966498 admin admin] Calling method '>' {{(pid=102409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:01:57.895791 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: INFO nova.api.openstack.requestlog [None req-97b75b13-c88d-4fe5-be6e-72586a966498 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002199 Feb 20 20:01:57.896193 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: [pid: 102409|app: 0|req: 39/76] 10.222.0.60 () {56 vars in 1074 bytes} [Sun Feb 20 20:01:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:01:58.089988 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG nova.api.openstack.wsgi [None req-59c54ddb-331d-4ee5-bea8-1f717646a740 admin admin] Calling method '>' {{(pid=102408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:01:58.091362 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:01:58.091362 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: warnings.warn(msg) Feb 20 20:01:58.092937 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG oslo_concurrency.lockutils [None req-59c54ddb-331d-4ee5-bea8-1f717646a740 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:01:58.093409 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG oslo_concurrency.lockutils [None req-59c54ddb-331d-4ee5-bea8-1f717646a740 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:01:58.094217 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG oslo_concurrency.lockutils [None req-59c54ddb-331d-4ee5-bea8-1f717646a740 admin admin] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:01:58.094650 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: DEBUG oslo_concurrency.lockutils [None req-59c54ddb-331d-4ee5-bea8-1f717646a740 admin admin] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:01:58.116406 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: INFO nova.api.openstack.requestlog [None req-59c54ddb-331d-4ee5-bea8-1f717646a740 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077389 Feb 20 20:01:58.116953 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: [pid: 102408|app: 0|req: 38/77] 10.222.0.60 () {60 vars in 1193 bytes} [Sun Feb 20 20:01:58 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:03:00.339541 dv-cinder-830085-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 20 20:03:00.340754 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: Sun Feb 20 20:03:00 2022 - graceful shutdown triggered... Feb 20 20:03:00.341490 dv-cinder-830085-1-iscsi devstack@n-api.service[102409]: Gracefully killing worker 2 (pid: 102409)... Feb 20 20:03:00.342103 dv-cinder-830085-1-iscsi devstack@n-api.service[102408]: Gracefully killing worker 1 (pid: 102408)... Feb 20 20:03:01.341132 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: worker 1 buried after 1 seconds Feb 20 20:03:01.341132 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: worker 2 buried after 1 seconds Feb 20 20:03:01.341132 dv-cinder-830085-1-iscsi devstack@n-api.service[102407]: goodbye to uWSGI. Feb 20 20:03:01.342584 dv-cinder-830085-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Feb 20 20:03:01.343167 dv-cinder-830085-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 20 20:03:01.346353 dv-cinder-830085-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 20 20:03:01.372611 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 20 20:03:01.374969 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Feb 20 20:03:01 2022] *** Feb 20 20:03:01.374969 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 20 20:03:01.374969 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 20 20:03:01.374969 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: nodename: dv-cinder-830085-1-iscsi Feb 20 20:03:01.374969 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: machine: x86_64 Feb 20 20:03:01.374969 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: clock source: unix Feb 20 20:03:01.374969 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: pcre jit disabled Feb 20 20:03:01.374969 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: detected number of CPU cores: 4 Feb 20 20:03:01.374969 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: current working directory: / Feb 20 20:03:01.374969 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: detected binary path: /usr/bin/uwsgi-core Feb 20 20:03:01.374969 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: your processes number limit is 47680 Feb 20 20:03:01.374969 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: your memory page size is 4096 bytes Feb 20 20:03:01.374969 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: detected max file descriptor number: 2048 Feb 20 20:03:01.374969 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: lock engine: pthread robust mutexes Feb 20 20:03:01.377886 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: thunder lock: enabled Feb 20 20:03:01.377886 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 20 20:03:01.377886 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 20 20:03:01.425217 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: Python main interpreter initialized at 0x5613de06b9c0 Feb 20 20:03:01.425217 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: python threads support enabled Feb 20 20:03:01.425217 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: your server socket listen backlog is limited to 100 connections Feb 20 20:03:01.425217 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: your mercy for graceful operations on workers is 90 seconds Feb 20 20:03:01.425653 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: mapped 403077 bytes (393 KB) for 2 cores Feb 20 20:03:01.425653 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: *** Operational MODE: preforking *** Feb 20 20:03:01.425975 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: *** uWSGI is running in multiple interpreter mode *** Feb 20 20:03:01.425975 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: spawned uWSGI master process (pid: 117069) Feb 20 20:03:01.426249 dv-cinder-830085-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 20 20:03:01.426794 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: spawned uWSGI worker 1 (pid: 117087, cores: 1) Feb 20 20:03:01.427262 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: spawned uWSGI worker 2 (pid: 117088, cores: 1) Feb 20 20:03:01.427384 dv-cinder-830085-1-iscsi devstack@n-api.service[117069]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 20 20:03:03.743472 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 20 20:03:03.743472 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: from cryptography.utils import int_from_bytes Feb 20 20:03:03.744542 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 20 20:03:03.744542 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: from cryptography.utils import int_from_bytes Feb 20 20:03:03.996066 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 20 20:03:03.996066 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: from cryptography.utils import int_from_bytes Feb 20 20:03:03.997033 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 20 20:03:03.997033 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: from cryptography.utils import int_from_bytes Feb 20 20:03:06.362902 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 20 20:03:06.363673 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 20 20:03:06.364236 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 20 20:03:06.364837 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 20 20:03:06.365267 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 20 20:03:06.365902 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.366477 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.367020 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.367544 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.368100 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.368870 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.369255 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.369791 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.370281 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.370564 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.370914 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.371265 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830085-1-iscsi {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.371617 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.371964 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.372260 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.372603 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.372925 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.373298 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.373665 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.374134 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.376114 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.376114 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.376114 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.376544 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.377634 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.378203 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.378807 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.379364 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.379956 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.380512 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.381173 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830085-1-iscsi {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.381682 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.382128 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.382450 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.382900 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.383229 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.383556 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.383884 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.384228 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.384556 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.384908 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.385274 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.385614 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.385953 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.386324 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.386656 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.387012 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.387593 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.388165 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.388600 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.388918 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.389283 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.389632 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.390020 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.390362 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.390668 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.390924 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.391239 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.391583 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.391921 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.392987 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.393398 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.393518 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.393890 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.394189 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.394527 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.394868 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.395196 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.395529 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.395874 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.396241 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.396583 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.397049 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.397425 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.397956 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.398537 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.399107 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.399661 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.400218 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.400758 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.401277 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.401817 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.402370 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.402951 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.404113 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.404113 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.404650 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.405014 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.405621 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.406180 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.406619 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.406959 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.407316 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.407645 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.408745 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.409329 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.409889 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.410442 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.410997 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.411517 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.412027 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.412530 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.413064 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.413699 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.414268 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.414816 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.415328 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.415870 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.416412 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.416988 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.417550 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.418092 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.418635 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.418795 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.419308 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.419542 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.419878 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.420208 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.420551 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.420879 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.421233 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.421574 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.421902 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.422225 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.423251 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.423251 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.423251 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.423727 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.424102 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.424438 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.424753 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.425118 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.425463 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.425792 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.426118 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.426441 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.426779 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:06.427136 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.427518 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.427880 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.428212 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.428563 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.428910 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.429301 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.429632 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.430142 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.430745 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.431292 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.431633 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.431972 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.432462 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.433054 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.433715 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.434142 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.434486 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.434958 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.435452 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.435980 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.436517 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.437060 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.437604 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.438163 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.438742 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.439331 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.439893 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.440434 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.440981 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.441612 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.442231 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.442851 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.443486 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.444013 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.444563 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.445203 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.445660 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.446202 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.446722 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.447270 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.447866 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.448459 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.449002 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.449638 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.450313 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.450723 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.451277 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.451774 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.452413 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.452856 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.453443 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.454024 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.454598 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.456010 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.456621 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.457217 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.457822 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.458373 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.458958 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.459544 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.460028 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.460394 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.460719 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.461236 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.461810 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.462398 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.462750 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.463088 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.463441 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.463774 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.464105 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.464443 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.464774 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.465147 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.465712 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.466041 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.466391 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.466723 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.467050 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.467405 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.467755 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.468087 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.468428 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.468766 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.469108 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.469449 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.469787 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.470088 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.471411 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.471743 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.472078 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.472398 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.472723 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.473045 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.473400 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.473720 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.474067 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.474392 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.474710 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.475030 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.475370 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.475728 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.476048 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.477264 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.477264 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.477264 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.477737 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.477737 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.478155 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.478386 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.478716 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.479043 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.479376 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.479716 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.480057 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.480546 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.480875 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.481308 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.481644 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.481982 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.482303 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.482631 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.482985 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.483340 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.483669 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.484005 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.484330 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.484660 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.484981 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.485337 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.485337 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.485337 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.485337 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.485337 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.487573 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.487573 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.487573 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.488050 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.488228 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.488713 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.488955 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.489219 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.489537 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.489862 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.490188 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.490678 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.491007 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.491326 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.491671 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.491968 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.492283 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.492607 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.492932 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.493281 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.493607 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.493924 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.494252 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.494571 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.494887 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.495202 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.495527 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.495868 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.496184 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.496524 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.496858 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.497211 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.497531 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.497869 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.498192 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.498510 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.498825 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.499143 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.499501 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.499825 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.500141 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.500470 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.500829 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.501175 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.501535 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.502439 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.502772 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.503092 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.503420 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.503746 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.504071 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.504390 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.504713 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.505036 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.505401 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.505724 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.506046 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.506364 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.506684 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.507001 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.507336 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.507933 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.508279 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.508607 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.508939 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.509300 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.509634 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.509979 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.510319 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.510703 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.511024 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.511344 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.511661 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.511998 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.512335 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.512634 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.512974 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.513289 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.513614 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.513930 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.514249 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.514565 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.514882 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.515213 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.515638 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.515851 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.516167 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.516511 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.516836 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.517230 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.518058 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.518377 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.518737 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.519061 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.519546 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.520031 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.520245 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.520572 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.520893 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.521322 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.521632 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.521904 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.522222 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.522560 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.522939 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.523286 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.523610 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.523930 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.524253 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.524573 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.524890 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.525240 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.525567 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.525914 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.526236 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.526553 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.526873 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.527220 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.527556 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.527867 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.528189 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.528519 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.528825 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.529176 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.529493 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.529824 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.530130 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.530468 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.530779 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.531123 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.531447 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.531768 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.532180 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.532527 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.532788 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.533187 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.533449 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.533794 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.534192 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.534430 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.534766 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.535081 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.535413 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.535736 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.536059 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.536370 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.536684 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.537002 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.537368 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.537687 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.538030 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.538351 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.538668 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.538987 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.539301 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.539665 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.539983 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.540356 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.540672 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.541003 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.541411 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.541812 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.542079 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.542411 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.542729 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.543054 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.543378 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.543716 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.544012 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.544328 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.544664 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.544988 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.545365 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.546160 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.546160 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.546375 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.546663 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.546990 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.547314 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.547640 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.547960 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.548281 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.549257 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.549257 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.549545 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.549665 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.549959 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.550237 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.550561 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.550882 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.551200 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.551546 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.551869 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.552187 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.552509 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.552826 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.553184 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.553512 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.553989 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.554293 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.554613 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.554931 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.555254 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.555578 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.555945 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.556238 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.556567 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.557015 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.557367 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.557693 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.558030 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.558348 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.558663 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.558985 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.559326 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.559641 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.559958 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.560272 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.560609 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.561202 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.561382 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.561713 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.562036 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.562375 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.562920 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.563251 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.563574 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.563913 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.564784 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.565139 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.565460 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.565790 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.566112 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.566454 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.566789 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.567119 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.567449 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.567770 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.568110 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.568445 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.568773 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.569123 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.570664 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.571020 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.571370 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.571755 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.572082 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.572412 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.572741 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.573073 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.573434 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.573745 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.574087 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.574414 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.574744 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.575075 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.575399 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.575723 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.576043 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.576383 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.576726 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.577048 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.577408 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.577748 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.578087 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.578406 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.578745 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.579066 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.579387 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.580575 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.580909 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.581306 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.581622 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.581959 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.582308 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.582654 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.582982 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.583331 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.583729 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.583988 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.584323 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.584661 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.584976 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.585329 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.585652 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.585974 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.586291 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.586605 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.586933 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.587247 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.587571 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.587887 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.588225 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.588543 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.588876 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.589242 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.589562 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.589880 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.590197 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.590871 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.591141 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.591494 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.591834 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.592264 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.592499 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.593830 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.594116 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.594388 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.594722 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.595055 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.596254 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.596706 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.596927 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.597292 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.597622 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.597954 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.598292 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.598626 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.599214 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.599561 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.599894 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.600245 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.600549 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.600879 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.601255 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.601584 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.601910 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.602236 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.602624 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.602895 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.603332 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.603552 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.603920 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.604273 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.604540 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.604860 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.605217 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.605593 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.605921 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.606249 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.606561 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.606893 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.607220 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.607546 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.607870 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.608196 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.608529 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.608857 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.609229 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.609563 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.609889 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.610229 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.610631 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.611017 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.611852 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.612182 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.612692 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.613417 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.613790 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.614230 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.614631 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.614631 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.615107 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.615345 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.615576 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.615896 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.616214 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.616692 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.616972 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.617446 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.617737 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.618093 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.618093 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.618797 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.618797 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.619313 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.619674 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.620005 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.620350 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.620690 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.621020 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.621379 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.621807 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.622117 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.622363 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.622656 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.623069 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.623309 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.623582 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.624013 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.624487 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.624487 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.625018 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.625274 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.625462 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.625777 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.626094 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.626412 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.627522 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.627791 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.628223 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.628549 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.628952 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.629233 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.629535 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.629865 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.630186 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.630514 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.630831 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.631156 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.631537 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.632143 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.632520 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.632520 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.632973 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.633452 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.633452 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.633955 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.634369 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.634768 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.634768 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.635427 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.635668 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.635974 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.636328 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.636671 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.636992 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.637805 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.637805 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.638263 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.638473 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.638688 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.638905 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.639302 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.639535 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.639859 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.640184 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.640507 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.640876 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.641187 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.641505 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.641935 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.642208 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.643069 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.643434 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.643723 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.644055 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.644382 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.644804 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.645067 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.645456 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.645679 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.646005 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.646333 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.646649 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.647096 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.647419 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.647839 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.648295 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.648514 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.648938 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.649235 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.649614 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.649851 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.650070 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.650316 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.650676 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.651069 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.651335 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.651656 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.651969 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.652287 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.652612 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.652949 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.653427 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.653739 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.653969 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.654299 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.654685 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.655168 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.655367 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.655665 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.655884 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.656205 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.656549 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.656876 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.657238 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.657536 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.658597 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.658781 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.659057 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.659352 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.659695 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.660007 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.660348 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.660680 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.661014 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.661394 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.666059 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.666059 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.666059 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.666059 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.666059 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.666059 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.666059 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.666059 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.667994 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.667994 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.667994 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.667994 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.667994 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.667994 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.667994 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.667994 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.670147 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.670147 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.670147 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.670147 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:06.670147 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 20 20:03:06.695781 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_db.sqlalchemy.engines [None req-1c6255bb-5b90-457c-80c0-d21dd9e520a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117087) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 20 20:03:06.773624 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.context [None req-1c6255bb-5b90-457c-80c0-d21dd9e520a0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),84b2375e-72b1-4ebf-b9cd-f9882b4f07ae(cell1) {{(pid=117087) load_cells /opt/stack/nova/nova/context.py:464}} Feb 20 20:03:06.778062 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1c6255bb-5b90-457c-80c0-d21dd9e520a0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:03:06.779744 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1c6255bb-5b90-457c-80c0-d21dd9e520a0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:03:06.780624 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1c6255bb-5b90-457c-80c0-d21dd9e520a0 None None] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:03:06.783221 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1c6255bb-5b90-457c-80c0-d21dd9e520a0 None None] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:03:06.795326 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_db.sqlalchemy.engines [None req-1c6255bb-5b90-457c-80c0-d21dd9e520a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117087) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 20 20:03:06.801800 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_db.sqlalchemy.engines [None req-1c6255bb-5b90-457c-80c0-d21dd9e520a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117087) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 20 20:03:07.026063 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_db.sqlalchemy.engines [None req-1c6255bb-5b90-457c-80c0-d21dd9e520a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117087) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 20 20:03:07.192036 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 20 20:03:07.192835 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 20 20:03:07.192835 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 20 20:03:07.193216 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 20 20:03:07.193479 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 20 20:03:07.193951 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.194289 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.194619 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.194949 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.195291 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.195616 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.195954 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.196282 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.196620 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.196884 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.197245 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.197584 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830085-1-iscsi {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.197914 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.198238 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.198557 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.198884 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.199195 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.199528 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.199838 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.200361 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.200682 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.200996 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.201342 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.201693 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.202012 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.202334 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.202662 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.202994 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.203303 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.203624 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.204042 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830085-1-iscsi {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.204367 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.204766 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.205738 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.206182 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.206508 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.206830 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.207163 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.207510 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.207832 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.208172 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.208503 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.208833 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.209188 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.209503 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.209823 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.210144 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.210471 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.210786 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.211171 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.211577 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.212083 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.212433 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.212941 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.213524 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.213969 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.214414 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.214985 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.215791 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.216299 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.216804 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.217378 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.217926 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.218476 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.218978 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.219515 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.220066 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.222807 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.222807 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.222807 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.223118 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.223710 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.224416 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.224529 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.225055 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.225696 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.226756 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.226892 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.227362 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.227896 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.228395 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.228927 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.229503 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.230068 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.230616 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.231145 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.231601 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.232147 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.232667 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.233206 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.233710 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.234245 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.234801 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.235344 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.236551 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.237940 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.238498 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.239052 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.239608 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.240115 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.240642 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.241226 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.241771 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.242318 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.242787 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.243123 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.243463 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.243801 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.244129 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.244471 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.244796 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.245138 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.245481 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.245802 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.246117 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.246459 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.246772 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.247163 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.247414 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.247728 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.248047 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.248377 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.248695 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.249011 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.249351 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.249671 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.249988 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.250299 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.250612 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.250931 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.252092 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.253402 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.253761 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.254097 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.254428 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.254755 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.255093 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 20 20:03:07.255450 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.255999 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.256598 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.257056 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.257638 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.258234 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.258811 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.259372 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.259941 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.260534 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.261225 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.261703 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.262229 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.262764 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.263349 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.263892 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.264470 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.265038 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.265656 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.266215 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.266796 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.268820 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.269468 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.270043 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.270635 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.271212 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.271611 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.271967 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.272326 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.272665 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.272998 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.273355 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.273710 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.274065 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.274398 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.274735 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.275139 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.275386 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.275719 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.276045 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.276373 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.276734 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.277184 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.277418 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.277719 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.278118 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.278378 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.278707 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.279032 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.279526 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.279833 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.280149 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.280478 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.280795 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.281281 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.281531 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.281794 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.282144 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.282462 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.283455 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.284375 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.284704 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.285027 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.285405 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.285734 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.286053 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.286397 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.286721 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.287067 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.287377 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.287694 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.288008 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.288338 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.288661 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.288984 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.289337 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.289660 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.289990 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.290311 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.290633 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.290979 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.291418 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.291639 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.291978 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.292314 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.292644 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.292952 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.293301 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.293619 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.293934 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.294247 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.294569 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.294882 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.295196 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.295543 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.295814 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.296126 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.296461 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.296777 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.297131 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.297429 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.297745 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.298100 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.299625 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.300670 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.301043 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.301478 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.301807 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.302137 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.302469 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.302798 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.303220 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.303627 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.303958 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.304294 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.304623 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.304957 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.305311 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.305806 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.306286 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.306781 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.307255 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.307796 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.308408 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.309003 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.309374 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.309865 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.310040 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.310368 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.310934 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.311508 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.311936 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.312267 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.312608 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.312938 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.313302 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.313632 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.314560 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.316077 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.316422 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.316751 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.317241 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.317844 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.318452 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.318800 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.319140 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.319480 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.319814 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.320222 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.320495 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.320823 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.321165 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.321492 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.321914 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.322268 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.322599 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.322918 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.323245 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.323569 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.323885 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.324363 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.324962 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.325480 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.326064 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.326614 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.327227 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.327799 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.328252 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.328820 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.329434 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.331005 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.331438 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.331728 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.332123 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.332445 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.332780 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.333622 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.334052 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.337135 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.337135 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.337135 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.337135 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.337135 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.337135 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.337135 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.337135 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.337987 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.337987 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.337987 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.337987 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.338406 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.338809 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.339204 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.339585 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.340003 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.340586 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.341217 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.341564 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.341892 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.342230 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.342563 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.342893 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.343241 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.343636 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.344135 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.344397 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.344724 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.345048 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.345909 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.346913 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.347815 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.347815 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.348303 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.348303 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.348758 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.348758 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.349256 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.349442 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.349696 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.350010 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.350340 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.350652 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.350991 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.351310 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.351692 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.351920 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.352202 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.352559 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.352872 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.353253 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.353591 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.354087 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.354409 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.354723 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.355056 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.355372 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.355688 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.356000 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.356319 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.356754 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.357236 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.357767 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.358301 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.358837 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.359362 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.359875 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.360399 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.360723 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.361977 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.362738 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.363063 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.363378 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.363711 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.364340 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.364591 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.365030 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.365614 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.366177 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.366495 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.367026 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.367539 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.368102 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.368656 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.369245 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.369799 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.370306 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.370596 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: WARNING keystonemiddleware.auth_token [None req-1c6255bb-5b90-457c-80c0-d21dd9e520a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 20 20:03:07.371323 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.371323 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.371846 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.372399 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.372904 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.373508 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.374032 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.374773 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.375357 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.375805 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.376143 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.376455 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.377350 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.377853 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.378359 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.378925 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.379471 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.380010 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.380527 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.380872 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: WARNING keystonemiddleware.auth_token [None req-1c6255bb-5b90-457c-80c0-d21dd9e520a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 20 20:03:07.381077 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.381598 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.382110 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.382656 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.383206 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.383805 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.384341 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.384976 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.385566 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.386102 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.387242 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.387242 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.393590 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.393590 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.393590 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.393590 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.393590 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.393590 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.393590 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.393590 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.395216 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.395216 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.395216 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.395216 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.395216 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.395216 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.395216 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.395216 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.396831 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.396831 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.396831 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.397315 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.397725 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.398314 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.399007 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.399615 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.400256 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.400843 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.401532 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.402130 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.402718 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.403349 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.403945 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.404478 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.405620 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.405925 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.406462 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.406901 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.407393 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.408257 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.409441 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.409866 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.410214 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.411710 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.411710 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.411710 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.411710 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.411710 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.411710 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.411710 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.411710 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.417425 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.417425 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.417425 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.417425 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.417932 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.418067 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.418557 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.419257 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.419650 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.420231 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.420978 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.421557 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.422109 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.422942 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.423497 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.425238 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.425592 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.425952 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.426307 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.426664 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.427014 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.427586 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.428325 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.428933 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.429568 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.430117 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.430644 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.431193 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.431739 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.432277 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.432845 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.433621 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.434181 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.434726 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.435292 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.435869 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.436369 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.436875 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.437476 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.438037 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.438588 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.439716 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.441213 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.441815 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.442343 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.442613 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.442951 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.443502 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.444069 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.444649 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.445021 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.445404 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.445756 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.446107 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.446436 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.446782 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.447116 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.447439 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.447763 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.448094 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.448700 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.449309 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.449908 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.450500 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.451118 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.451700 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.452350 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.452971 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.453614 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.454219 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.456613 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.457267 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.457863 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.458448 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.459023 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.459612 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.460209 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.460745 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.462094 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.462671 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.463222 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.463864 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.464468 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.465123 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.465962 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.466549 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.467139 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.467693 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.468336 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.468916 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.469604 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.470280 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.471838 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.472473 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.473059 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.473739 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.474361 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.474976 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.475585 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.476178 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.476770 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.477407 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.478001 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.478608 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.479198 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.479775 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.480365 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.481411 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.481955 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.482365 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.482830 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.483171 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.483513 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.483974 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.484183 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.484518 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.484851 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.485214 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.485573 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.485955 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.487136 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.487404 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.487785 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.488269 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.488443 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.488844 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.489143 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.489455 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.489783 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.490117 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.490559 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.490785 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.491084 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.491408 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.491739 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.492160 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.492394 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.492714 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.493042 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.493399 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.493748 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.494296 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.494565 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.494906 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.495232 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.495561 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.496155 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.496491 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.496843 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.497303 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.497553 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.497886 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.498220 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.498563 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.498975 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.499192 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.499517 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.500175 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.500685 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.501242 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.502132 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.503048 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.503424 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.503755 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.505155 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.505155 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.505155 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.505641 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.505799 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.506066 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.506390 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.506731 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.507051 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.507500 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.507675 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.507998 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.508313 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.508630 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.508957 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.509310 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.509626 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.509947 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.510261 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.510597 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.510916 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.511228 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.511543 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.511865 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.512272 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.512575 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.512794 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.513123 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.513453 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.513766 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.514088 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.514617 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.514790 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.515023 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.515347 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.515749 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.516107 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.516426 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.516739 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.517070 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.518861 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.519214 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.519551 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.519885 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.523297 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.523297 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.523297 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.523297 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.523297 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.523297 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.523297 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.523297 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.524994 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.524994 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.524994 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.524994 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.524994 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.524994 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.524994 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.526375 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.526375 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.526375 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.526375 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.527015 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.527015 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.527334 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.527495 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.527913 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.528133 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.528447 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.528772 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.529180 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.529560 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.529750 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.530066 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.530384 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.530713 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.531052 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.531374 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.531686 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.532130 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.532454 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.532832 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.533769 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.534102 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.534437 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.534782 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.535529 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.535529 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.535997 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.536164 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.536385 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.536726 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.537059 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.537400 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.537717 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.538029 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.538352 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.538763 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.539017 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.539343 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.539700 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.540004 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.540325 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.540645 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.540976 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.541350 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.541683 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.542010 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.542344 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.542662 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.542987 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.543299 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.543818 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.544003 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.544237 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.544576 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.544911 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.545702 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.545702 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.546387 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.546387 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.546879 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.546879 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.547212 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.547465 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.547790 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.548107 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.548471 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.549455 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.549765 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.550140 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.550393 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.550738 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.551073 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.551412 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.551851 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.552189 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.552482 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.552763 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.553112 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.553488 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.553748 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 20 20:03:07.554247 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 20 20:03:07.582769 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_db.sqlalchemy.engines [None req-28c5dcda-22cb-4215-a21a-ac34ce80b65b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 20 20:03:07.656890 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.context [None req-28c5dcda-22cb-4215-a21a-ac34ce80b65b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),84b2375e-72b1-4ebf-b9cd-f9882b4f07ae(cell1) {{(pid=117088) load_cells /opt/stack/nova/nova/context.py:464}} Feb 20 20:03:07.662809 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-28c5dcda-22cb-4215-a21a-ac34ce80b65b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:03:07.664433 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-28c5dcda-22cb-4215-a21a-ac34ce80b65b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:03:07.665323 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-28c5dcda-22cb-4215-a21a-ac34ce80b65b None None] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:03:07.667358 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-28c5dcda-22cb-4215-a21a-ac34ce80b65b None None] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:03:07.679425 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_db.sqlalchemy.engines [None req-28c5dcda-22cb-4215-a21a-ac34ce80b65b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 20 20:03:07.683176 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_db.sqlalchemy.engines [None req-28c5dcda-22cb-4215-a21a-ac34ce80b65b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 20 20:03:07.780558 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: WARNING keystonemiddleware.auth_token [None req-1c6255bb-5b90-457c-80c0-d21dd9e520a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 20 20:03:07.786673 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: WARNING keystonemiddleware.auth_token [None req-1c6255bb-5b90-457c-80c0-d21dd9e520a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 20 20:03:07.792104 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5613de06b9c0 pid: 117087 (default app) Feb 20 20:03:07.909229 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_db.sqlalchemy.engines [None req-28c5dcda-22cb-4215-a21a-ac34ce80b65b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 20 20:03:08.266707 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: WARNING keystonemiddleware.auth_token [None req-28c5dcda-22cb-4215-a21a-ac34ce80b65b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 20 20:03:08.275264 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: WARNING keystonemiddleware.auth_token [None req-28c5dcda-22cb-4215-a21a-ac34ce80b65b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 20 20:03:08.630783 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: WARNING keystonemiddleware.auth_token [None req-28c5dcda-22cb-4215-a21a-ac34ce80b65b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 20 20:03:08.636428 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: WARNING keystonemiddleware.auth_token [None req-28c5dcda-22cb-4215-a21a-ac34ce80b65b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 20 20:03:08.641954 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5613de06b9c0 pid: 117088 (default app) Feb 20 20:03:46.790890 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-51783c67-6ed6-430f-9546-df355bc72a9f tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] Action: 'create', calling method: .version_select at 0x7fdd934850d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1252693580"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:03:46.928816 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-97ad229e-46db-48d3-ac20-eaa74536aae9 tempest-VolumesNegativeTest-506142199 tempest-VolumesNegativeTest-506142199-project] Action: 'create', calling method: .version_select at 0x7fdd9343c0d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1581080494", "metadata": {"Type": "work"}}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:03:46.933053 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-97ad229e-46db-48d3-ac20-eaa74536aae9 tempest-VolumesNegativeTest-506142199 tempest-VolumesNegativeTest-506142199-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:03:46.936326 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-97ad229e-46db-48d3-ac20-eaa74536aae9 tempest-VolumesNegativeTest-506142199 tempest-VolumesNegativeTest-506142199-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.359443 Feb 20 20:03:46.945189 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 1/1] 10.222.0.60 () {60 vars in 1155 bytes} [Sun Feb 20 20:03:45 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1370 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 20 20:03:46.957409 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ad8492bc-a438-4e8d-af81-615b506405e2 tempest-VolumesNegativeTest-506142199 tempest-VolumesNegativeTest-506142199-project] Action: 'create', calling method: .version_select at 0x7fdd9343cca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1120771704", "metadata": {"Type": "work"}}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:03:46.962195 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ad8492bc-a438-4e8d-af81-615b506405e2 tempest-VolumesNegativeTest-506142199 tempest-VolumesNegativeTest-506142199-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:03:46.964117 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ad8492bc-a438-4e8d-af81-615b506405e2 tempest-VolumesNegativeTest-506142199 tempest-VolumesNegativeTest-506142199-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016670 Feb 20 20:03:46.973268 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 2/2] 10.222.0.60 () {60 vars in 1155 bytes} [Sun Feb 20 20:03:46 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 20 20:03:46.978029 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-80a655de-4e29-4710-a615-05b48e7b0440 tempest-VolumesNegativeTest-506142199 tempest-VolumesNegativeTest-506142199-project] Action: 'create', calling method: .version_select at 0x7fdd9343cc10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1271535784", "metadata": {"Type": "work"}}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:03:46.979355 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-80a655de-4e29-4710-a615-05b48e7b0440 tempest-VolumesNegativeTest-506142199 tempest-VolumesNegativeTest-506142199-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:03:46.980297 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-80a655de-4e29-4710-a615-05b48e7b0440 tempest-VolumesNegativeTest-506142199 tempest-VolumesNegativeTest-506142199-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005874 Feb 20 20:03:46.981223 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 3/3] 10.222.0.60 () {60 vars in 1155 bytes} [Sun Feb 20 20:03:46 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 20 20:03:46.992985 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9fa0712b-17be-4977-b69a-608640ea80b6 tempest-VolumesNegativeTest-506142199 tempest-VolumesNegativeTest-506142199-project] Calling method '.version_select at 0x7fdd9336d700>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:48.152510 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-9fa0712b-17be-4977-b69a-608640ea80b6 tempest-VolumesNegativeTest-506142199 tempest-VolumesNegativeTest-506142199-project] HTTP exception thrown: Volume tempest-invalid-595289244 could not be found. Feb 20 20:03:48.154233 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9fa0712b-17be-4977-b69a-608640ea80b6 tempest-VolumesNegativeTest-506142199 tempest-VolumesNegativeTest-506142199-project] Returning 404 to user: Volume tempest-invalid-595289244 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:03:48.155451 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9fa0712b-17be-4977-b69a-608640ea80b6 tempest-VolumesNegativeTest-506142199 tempest-VolumesNegativeTest-506142199-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-595289244" status: 404 len: 98 microversion: 2.1 time: 1.167043 Feb 20 20:03:48.156783 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 4/4] 10.222.0.60 () {58 vars in 1214 bytes} [Sun Feb 20 20:03:46 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-595289244 => generated 98 bytes in 1169 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 20 20:03:48.175119 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ce8ae034-2061-42f4-aa39-db30c1142c44 tempest-VolumesNegativeTest-506142199 tempest-VolumesNegativeTest-506142199-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005255 Feb 20 20:03:48.175119 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 5/5] 10.222.0.60 () {58 vars in 1139 bytes} [Sun Feb 20 20:03:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Feb 20 20:03:48.204964 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2243e4aa-acd7-4aa0-8909-69a315615c7d tempest-VolumesNegativeTest-506142199 tempest-VolumesNegativeTest-506142199-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.027829 Feb 20 20:03:48.207738 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 6/6] 10.222.0.60 () {58 vars in 1136 bytes} [Sun Feb 20 20:03:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 20 20:03:48.222545 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0ecdfaea-87b4-4378-9a45-183ff311567f tempest-VolumesNegativeTest-506142199 tempest-VolumesNegativeTest-506142199-project] Calling method '.version_select at 0x7fdd9336d430>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:48.387877 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-51783c67-6ed6-430f-9546-df355bc72a9f tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.974960 Feb 20 20:03:48.388530 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 1/7] 10.222.0.60 () {60 vars in 1154 bytes} [Sun Feb 20 20:03:45 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2977 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 20 20:03:48.401739 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b3d3d318-9525-43b7-9396-0673eb5a8b9c tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] Calling method '.version_select at 0x7fdd93345ca0>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:48.422942 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-0ecdfaea-87b4-4378-9a45-183ff311567f tempest-VolumesNegativeTest-506142199 tempest-VolumesNegativeTest-506142199-project] HTTP exception thrown: Volume f8317b88-ab8a-4d78-bde4-40a4fad1831f could not be found. Feb 20 20:03:48.423926 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0ecdfaea-87b4-4378-9a45-183ff311567f tempest-VolumesNegativeTest-506142199 tempest-VolumesNegativeTest-506142199-project] Returning 404 to user: Volume f8317b88-ab8a-4d78-bde4-40a4fad1831f could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:03:48.424757 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-0ecdfaea-87b4-4378-9a45-183ff311567f tempest-VolumesNegativeTest-506142199 tempest-VolumesNegativeTest-506142199-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/f8317b88-ab8a-4d78-bde4-40a4fad1831f" status: 404 len: 109 microversion: 2.1 time: 0.213131 Feb 20 20:03:48.425330 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 7/8] 10.222.0.60 () {58 vars in 1247 bytes} [Sun Feb 20 20:03:48 2022] DELETE /compute/v2.1/os-volumes/f8317b88-ab8a-4d78-bde4-40a4fad1831f => generated 109 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:03:48.435139 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a8f1f352-dd34-49d3-8223-11fec0c2f75d tempest-VolumesNegativeTest-506142199 tempest-VolumesNegativeTest-506142199-project] Calling method '.version_select at 0x7fdd933139d0>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:48.518845 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b3d3d318-9525-43b7-9396-0673eb5a8b9c tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/5500f434-fb4b-4e41-b18e-1a0f9bb0328c" status: 200 len: 345 microversion: 2.1 time: 0.120603 Feb 20 20:03:48.520056 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 2/9] 10.222.0.60 () {58 vars in 1244 bytes} [Sun Feb 20 20:03:48 2022] GET /compute/v2.1/os-volumes/5500f434-fb4b-4e41-b18e-1a0f9bb0328c => generated 345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:03:48.529284 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-a8f1f352-dd34-49d3-8223-11fec0c2f75d tempest-VolumesNegativeTest-506142199 tempest-VolumesNegativeTest-506142199-project] HTTP exception thrown: Volume a8fffb18-1233-4594-af18-2c70871b1039 could not be found. Feb 20 20:03:48.529284 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a8f1f352-dd34-49d3-8223-11fec0c2f75d tempest-VolumesNegativeTest-506142199 tempest-VolumesNegativeTest-506142199-project] Returning 404 to user: Volume a8fffb18-1233-4594-af18-2c70871b1039 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:03:48.529821 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a8f1f352-dd34-49d3-8223-11fec0c2f75d tempest-VolumesNegativeTest-506142199 tempest-VolumesNegativeTest-506142199-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/a8fffb18-1233-4594-af18-2c70871b1039" status: 404 len: 109 microversion: 2.1 time: 0.098874 Feb 20 20:03:48.531189 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 8/10] 10.222.0.60 () {58 vars in 1244 bytes} [Sun Feb 20 20:03:48 2022] GET /compute/v2.1/os-volumes/a8fffb18-1233-4594-af18-2c70871b1039 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:03:49.474986 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-75506944-c3b6-4fd6-b26a-fb2e3c1b3656 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1251486595", "imageRef": "61c0cc70-53e3-40ed-b353-ec1b5fc4eea4", "flavorRef": "452", "networks": [{"uuid": "3a4cb438-6960-42f9-a911-4a7d769daf28"}]}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:03:49.532327 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-285228ac-75d7-4c46-865b-4da9eb50c3ac tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] Calling method '.version_select at 0x7fdd93313e50>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:49.647884 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.network.neutron [None req-75506944-c3b6-4fd6-b26a-fb2e3c1b3656 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] validate_networks() for [('3a4cb438-6960-42f9-a911-4a7d769daf28', None, None, None, None, None)] {{(pid=117087) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 20 20:03:49.652756 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-285228ac-75d7-4c46-865b-4da9eb50c3ac tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/5500f434-fb4b-4e41-b18e-1a0f9bb0328c" status: 200 len: 345 microversion: 2.1 time: 0.124798 Feb 20 20:03:49.654032 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 9/11] 10.222.0.60 () {58 vars in 1244 bytes} [Sun Feb 20 20:03:49 2022] GET /compute/v2.1/os-volumes/5500f434-fb4b-4e41-b18e-1a0f9bb0328c => generated 345 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:03:50.439394 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f954661f-a412-47ff-922f-5f0bc3d1d394 tempest-VolumesTestJSON-1476965542 tempest-VolumesTestJSON-1476965542-project] Calling method '.version_select at 0x7fdd9336d430>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:50.589763 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f954661f-a412-47ff-922f-5f0bc3d1d394 tempest-VolumesTestJSON-1476965542 tempest-VolumesTestJSON-1476965542-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8bde5123-4c86-4a3f-b632-b94388e8a363" status: 200 len: 350 microversion: 2.1 time: 0.153311 Feb 20 20:03:50.591162 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 10/12] 10.222.0.60 () {58 vars in 1244 bytes} [Sun Feb 20 20:03:50 2022] GET /compute/v2.1/os-volumes/8bde5123-4c86-4a3f-b632-b94388e8a363 => generated 350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:03:50.672951 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5d8b2400-ed7b-4e29-bc09-7025155f37ec tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] Calling method '.version_select at 0x7fdd93313ee0>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:50.772825 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5d8b2400-ed7b-4e29-bc09-7025155f37ec tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/5500f434-fb4b-4e41-b18e-1a0f9bb0328c" status: 200 len: 346 microversion: 2.1 time: 0.107249 Feb 20 20:03:50.772825 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 11/13] 10.222.0.60 () {58 vars in 1244 bytes} [Sun Feb 20 20:03:50 2022] GET /compute/v2.1/os-volumes/5500f434-fb4b-4e41-b18e-1a0f9bb0328c => generated 346 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:03:50.783862 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3800342c-02c3-44f8-bfd3-0adbabeacc11 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] Action: 'create', calling method: .version_select at 0x7fdd933135e0>, body: {"snapshot": {"volume_id": "5500f434-fb4b-4e41-b18e-1a0f9bb0328c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-585223341"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:03:51.268341 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-75506944-c3b6-4fd6-b26a-fb2e3c1b3656 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Flavor limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 20 20:03:51.268906 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-75506944-c3b6-4fd6-b26a-fb2e3c1b3656 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Image limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 20 20:03:51.269302 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-75506944-c3b6-4fd6-b26a-fb2e3c1b3656 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Flavor pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 20 20:03:51.269714 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-75506944-c3b6-4fd6-b26a-fb2e3c1b3656 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Image pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 20 20:03:51.270130 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-75506944-c3b6-4fd6-b26a-fb2e3c1b3656 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 20 20:03:51.291715 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-75506944-c3b6-4fd6-b26a-fb2e3c1b3656 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:03:51.292161 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-75506944-c3b6-4fd6-b26a-fb2e3c1b3656 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:03:51.295780 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-75506944-c3b6-4fd6-b26a-fb2e3c1b3656 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:03:51.297310 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-75506944-c3b6-4fd6-b26a-fb2e3c1b3656 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:03:51.378274 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-75506944-c3b6-4fd6-b26a-fb2e3c1b3656 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Getting quotas for project da1818d276f14d708be99c940260b757. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:03:51.400542 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-3800342c-02c3-44f8-bfd3-0adbabeacc11 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.621321 Feb 20 20:03:51.401623 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 12/14] 10.222.0.60 () {60 vars in 1161 bytes} [Sun Feb 20 20:03:50 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:03:51.413397 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-707910b2-5afd-4471-96f6-e55cf696bd75 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] Calling method '.version_select at 0x7fdd932a24c0>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:51.431350 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-75506944-c3b6-4fd6-b26a-fb2e3c1b3656 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Getting quotas for user 11e42677567d418c84d335c9bfb42c55 and project da1818d276f14d708be99c940260b757. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:03:51.447733 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-75506944-c3b6-4fd6-b26a-fb2e3c1b3656 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Going to run 1 instances... {{(pid=117087) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 20 20:03:51.451108 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-75506944-c3b6-4fd6-b26a-fb2e3c1b3656 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61c0cc70-53e3-40ed-b353-ec1b5fc4eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 20 20:03:51.523012 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-707910b2-5afd-4471-96f6-e55cf696bd75 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/e40e86f6-decd-4116-bb8d-37689d69be3c" status: 200 len: 286 microversion: 2.1 time: 0.113430 Feb 20 20:03:51.524001 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 13/15] 10.222.0.60 () {58 vars in 1250 bytes} [Sun Feb 20 20:03:51 2022] GET /compute/v2.1/os-snapshots/e40e86f6-decd-4116-bb8d-37689d69be3c => generated 286 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:03:51.533695 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-76de09ad-a4a5-4487-a784-6bc5dd2cddc6 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] Calling method '.version_select at 0x7fdd93309ca0>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:51.609658 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-76de09ad-a4a5-4487-a784-6bc5dd2cddc6 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.079056 Feb 20 20:03:51.610951 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 14/16] 10.222.0.60 () {58 vars in 1139 bytes} [Sun Feb 20 20:03:51 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:03:51.631405 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c46cbfa8-4154-4d5c-b694-7c2359681cc1 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] Calling method '.version_select at 0x7fdd933130d0>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:51.687649 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c46cbfa8-4154-4d5c-b694-7c2359681cc1 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/e40e86f6-decd-4116-bb8d-37689d69be3c" status: 200 len: 286 microversion: 2.1 time: 0.058871 Feb 20 20:03:51.688776 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 15/17] 10.222.0.60 () {58 vars in 1250 bytes} [Sun Feb 20 20:03:51 2022] GET /compute/v2.1/os-snapshots/e40e86f6-decd-4116-bb8d-37689d69be3c => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:03:51.722450 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-75506944-c3b6-4fd6-b26a-fb2e3c1b3656 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.640360 Feb 20 20:03:51.724578 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 3/18] 10.222.0.60 () {60 vars in 1146 bytes} [Sun Feb 20 20:03:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 20 20:03:51.735809 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-eb695725-f9ac-4cc5-b660-fc26c5ba11c4 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:51.737669 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-eb695725-f9ac-4cc5-b660-fc26c5ba11c4 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:03:52.001603 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-eb695725-f9ac-4cc5-b660-fc26c5ba11c4 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:03:52.041873 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-eb695725-f9ac-4cc5-b660-fc26c5ba11c4 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1215 microversion: 2.1 time: 0.310494 Feb 20 20:03:52.043480 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 16/19] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:03:51 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1215 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:03:52.701567 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4c25eefc-4217-4470-9a93-5f7bdb134fc9 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] Calling method '.version_select at 0x7fdd9325f430>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:52.818409 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4c25eefc-4217-4470-9a93-5f7bdb134fc9 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/e40e86f6-decd-4116-bb8d-37689d69be3c" status: 200 len: 286 microversion: 2.1 time: 0.118156 Feb 20 20:03:52.818409 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 4/20] 10.222.0.60 () {58 vars in 1250 bytes} [Sun Feb 20 20:03:52 2022] GET /compute/v2.1/os-snapshots/e40e86f6-decd-4116-bb8d-37689d69be3c => generated 286 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:03:53.059494 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-517fee50-06f2-40ce-8070-1da16ccd1a94 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:53.060114 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-517fee50-06f2-40ce-8070-1da16ccd1a94 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:03:53.224398 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-517fee50-06f2-40ce-8070-1da16ccd1a94 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:03:53.231963 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-517fee50-06f2-40ce-8070-1da16ccd1a94 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1215 microversion: 2.1 time: 0.175843 Feb 20 20:03:53.232406 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 17/21] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:03:53 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1215 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:03:53.922473 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-60ca9f29-7e68-470e-ae14-65ff75cfebf1 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] Calling method '.version_select at 0x7fdd9325fee0>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:53.959034 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-60ca9f29-7e68-470e-ae14-65ff75cfebf1 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/e40e86f6-decd-4116-bb8d-37689d69be3c" status: 200 len: 286 microversion: 2.1 time: 0.132078 Feb 20 20:03:53.975779 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 5/22] 10.222.0.60 () {58 vars in 1250 bytes} [Sun Feb 20 20:03:53 2022] GET /compute/v2.1/os-snapshots/e40e86f6-decd-4116-bb8d-37689d69be3c => generated 286 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:03:54.251191 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a142d56a-79af-47f4-aa4e-b277ab29512d tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:54.252701 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a142d56a-79af-47f4-aa4e-b277ab29512d tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:03:54.617898 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a142d56a-79af-47f4-aa4e-b277ab29512d tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:03:54.625607 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a142d56a-79af-47f4-aa4e-b277ab29512d tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1215 microversion: 2.1 time: 0.380197 Feb 20 20:03:54.638828 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 18/23] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:03:54 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1215 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:03:54.978627 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c14eabae-0bcb-4c9d-aae3-f893ca9f4683 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] Calling method '.version_select at 0x7fdd9325f790>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:55.069804 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c14eabae-0bcb-4c9d-aae3-f893ca9f4683 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/e40e86f6-decd-4116-bb8d-37689d69be3c" status: 200 len: 286 microversion: 2.1 time: 0.094978 Feb 20 20:03:55.071052 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 6/24] 10.222.0.60 () {58 vars in 1250 bytes} [Sun Feb 20 20:03:54 2022] GET /compute/v2.1/os-snapshots/e40e86f6-decd-4116-bb8d-37689d69be3c => generated 286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:03:55.646699 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5bd5bdad-63f5-42a6-9d17-992bdaa789c7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:55.647474 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5bd5bdad-63f5-42a6-9d17-992bdaa789c7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:03:55.665351 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5bd5bdad-63f5-42a6-9d17-992bdaa789c7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:03:55.666607 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5bd5bdad-63f5-42a6-9d17-992bdaa789c7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:03:55.673012 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5bd5bdad-63f5-42a6-9d17-992bdaa789c7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:03:55.680337 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5bd5bdad-63f5-42a6-9d17-992bdaa789c7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:03:56.083329 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c4f7e98c-7a42-43c5-94cd-5f2182e5f747 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] Calling method '.version_select at 0x7fdd929fe790>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:56.167801 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c4f7e98c-7a42-43c5-94cd-5f2182e5f747 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/e40e86f6-decd-4116-bb8d-37689d69be3c" status: 200 len: 287 microversion: 2.1 time: 0.088148 Feb 20 20:03:56.177587 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 7/25] 10.222.0.60 () {58 vars in 1250 bytes} [Sun Feb 20 20:03:56 2022] GET /compute/v2.1/os-snapshots/e40e86f6-decd-4116-bb8d-37689d69be3c => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:03:56.185640 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4f91f52d-cb34-4713-b643-dcde5d80dcb0 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] Calling method '.version_select at 0x7fdd929fef70>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:56.278598 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5bd5bdad-63f5-42a6-9d17-992bdaa789c7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:03:56.308798 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5bd5bdad-63f5-42a6-9d17-992bdaa789c7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1211 microversion: 2.1 time: 0.665836 Feb 20 20:03:56.313048 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 19/26] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:03:55 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1211 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:03:56.321745 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5a41fa94-56bf-4cba-ac7d-a5bef51f8fee tempest-VolumesTestJSON-1476965542 tempest-VolumesTestJSON-1476965542-project] Calling method '.version_select at 0x7fdd931e7550>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:56.460828 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4f91f52d-cb34-4713-b643-dcde5d80dcb0 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/e40e86f6-decd-4116-bb8d-37689d69be3c" status: 202 len: 0 microversion: 2.1 time: 0.281717 Feb 20 20:03:56.466696 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 8/27] 10.222.0.60 () {58 vars in 1253 bytes} [Sun Feb 20 20:03:56 2022] DELETE /compute/v2.1/os-snapshots/e40e86f6-decd-4116-bb8d-37689d69be3c => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:03:56.476785 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-56414afe-f9d8-4bcb-94f5-b93320b3caf6 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] Calling method '.version_select at 0x7fdd929fe940>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:56.582917 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5a41fa94-56bf-4cba-ac7d-a5bef51f8fee tempest-VolumesTestJSON-1476965542 tempest-VolumesTestJSON-1476965542-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/c3acd61b-54c1-4dba-8237-2a9431640e6c" status: 200 len: 351 microversion: 2.1 time: 0.268440 Feb 20 20:03:56.584244 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 20/28] 10.222.0.60 () {58 vars in 1244 bytes} [Sun Feb 20 20:03:56 2022] GET /compute/v2.1/os-volumes/c3acd61b-54c1-4dba-8237-2a9431640e6c => generated 351 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:03:56.672124 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-56414afe-f9d8-4bcb-94f5-b93320b3caf6 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/e40e86f6-decd-4116-bb8d-37689d69be3c" status: 200 len: 286 microversion: 2.1 time: 0.202182 Feb 20 20:03:56.676519 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 9/29] 10.222.0.60 () {58 vars in 1250 bytes} [Sun Feb 20 20:03:56 2022] GET /compute/v2.1/os-snapshots/e40e86f6-decd-4116-bb8d-37689d69be3c => generated 286 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:03:57.336057 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7514fee5-cec1-4f36-8d26-2c37ed28647f tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:57.338050 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7514fee5-cec1-4f36-8d26-2c37ed28647f tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:03:57.349147 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7514fee5-cec1-4f36-8d26-2c37ed28647f tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:03:57.349425 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7514fee5-cec1-4f36-8d26-2c37ed28647f tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:03:57.350801 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7514fee5-cec1-4f36-8d26-2c37ed28647f tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:03:57.351961 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7514fee5-cec1-4f36-8d26-2c37ed28647f tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:03:57.683914 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8e11f45e-d85e-428a-bd43-0f9e3f30c60f tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] Calling method '.version_select at 0x7fdd9325f790>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:57.701281 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7514fee5-cec1-4f36-8d26-2c37ed28647f tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:03:57.734335 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7514fee5-cec1-4f36-8d26-2c37ed28647f tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1273 microversion: 2.1 time: 0.378410 Feb 20 20:03:57.735320 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 21/30] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:03:57 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1273 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:03:57.841262 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-8e11f45e-d85e-428a-bd43-0f9e3f30c60f tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] HTTP exception thrown: Snapshot e40e86f6-decd-4116-bb8d-37689d69be3c could not be found. Feb 20 20:03:57.841718 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8e11f45e-d85e-428a-bd43-0f9e3f30c60f tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] Returning 404 to user: Snapshot e40e86f6-decd-4116-bb8d-37689d69be3c could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:03:57.842660 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8e11f45e-d85e-428a-bd43-0f9e3f30c60f tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/e40e86f6-decd-4116-bb8d-37689d69be3c" status: 404 len: 111 microversion: 2.1 time: 0.162639 Feb 20 20:03:57.843977 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 10/31] 10.222.0.60 () {58 vars in 1250 bytes} [Sun Feb 20 20:03:57 2022] GET /compute/v2.1/os-snapshots/e40e86f6-decd-4116-bb8d-37689d69be3c => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:03:57.853327 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a4894598-c90b-4bff-82bc-0587e78a68b0 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] Calling method '.version_select at 0x7fdd9321a820>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:58.186085 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a4894598-c90b-4bff-82bc-0587e78a68b0 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/5500f434-fb4b-4e41-b18e-1a0f9bb0328c" status: 202 len: 0 microversion: 2.1 time: 0.337126 Feb 20 20:03:58.192001 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 22/32] 10.222.0.60 () {58 vars in 1247 bytes} [Sun Feb 20 20:03:57 2022] DELETE /compute/v2.1/os-volumes/5500f434-fb4b-4e41-b18e-1a0f9bb0328c => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:03:58.205907 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1e2321bc-a659-4acf-99c8-eaa0ec4fb683 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] Calling method '.version_select at 0x7fdd9325f8b0>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:58.320869 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1e2321bc-a659-4acf-99c8-eaa0ec4fb683 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/5500f434-fb4b-4e41-b18e-1a0f9bb0328c" status: 200 len: 345 microversion: 2.1 time: 0.123492 Feb 20 20:03:58.322104 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 11/33] 10.222.0.60 () {58 vars in 1244 bytes} [Sun Feb 20 20:03:58 2022] GET /compute/v2.1/os-volumes/5500f434-fb4b-4e41-b18e-1a0f9bb0328c => generated 345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:03:58.740321 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-081ff82a-e51f-422b-885d-1085b40eeb68 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:58.741666 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-081ff82a-e51f-422b-885d-1085b40eeb68 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:03:58.759561 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-081ff82a-e51f-422b-885d-1085b40eeb68 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:03:58.760193 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-081ff82a-e51f-422b-885d-1085b40eeb68 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:03:58.761671 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-081ff82a-e51f-422b-885d-1085b40eeb68 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:03:58.762999 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-081ff82a-e51f-422b-885d-1085b40eeb68 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:03:59.179485 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f8a34307-1fc2-4540-90e5-78ee32c5f5ab tempest-VolumesTestJSON-1476965542 tempest-VolumesTestJSON-1476965542-project] Calling method '.version_select at 0x7fdd929fe1f0>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:59.370721 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f8a34307-1fc2-4540-90e5-78ee32c5f5ab tempest-VolumesTestJSON-1476965542 tempest-VolumesTestJSON-1476965542-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/1bc8c957-aa64-41b4-92cf-8e821146cdf9" status: 200 len: 351 microversion: 2.1 time: 0.196715 Feb 20 20:03:59.371675 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 12/34] 10.222.0.60 () {58 vars in 1244 bytes} [Sun Feb 20 20:03:59 2022] GET /compute/v2.1/os-volumes/1bc8c957-aa64-41b4-92cf-8e821146cdf9 => generated 351 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:03:59.377858 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f3c040ed-1ede-4b73-bebc-2087c4ceb4d0 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] Calling method '.version_select at 0x7fdd9325fca0>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:59.490450 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-f3c040ed-1ede-4b73-bebc-2087c4ceb4d0 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] HTTP exception thrown: Volume 5500f434-fb4b-4e41-b18e-1a0f9bb0328c could not be found. Feb 20 20:03:59.491534 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f3c040ed-1ede-4b73-bebc-2087c4ceb4d0 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] Returning 404 to user: Volume 5500f434-fb4b-4e41-b18e-1a0f9bb0328c could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:03:59.492557 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f3c040ed-1ede-4b73-bebc-2087c4ceb4d0 tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/5500f434-fb4b-4e41-b18e-1a0f9bb0328c" status: 404 len: 109 microversion: 2.1 time: 0.119654 Feb 20 20:03:59.493587 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 13/35] 10.222.0.60 () {58 vars in 1244 bytes} [Sun Feb 20 20:03:59 2022] GET /compute/v2.1/os-volumes/5500f434-fb4b-4e41-b18e-1a0f9bb0328c => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:03:59.498366 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-cbdc69b9-9bc8-4a27-b0a8-5ff8b4d7dbf7 tempest-VolumesTestJSON-1476965542 tempest-VolumesTestJSON-1476965542-project] Calling method '.version_select at 0x7fdd929fe820>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:03:59.982896 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-cbdc69b9-9bc8-4a27-b0a8-5ff8b4d7dbf7 tempest-VolumesTestJSON-1476965542 tempest-VolumesTestJSON-1476965542-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.487352 Feb 20 20:03:59.985126 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 14/36] 10.222.0.60 () {58 vars in 1133 bytes} [Sun Feb 20 20:03:59 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:03:59.998465 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-54616739-7642-4cc8-a4b3-8db324dcdafc tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] Calling method '.version_select at 0x7fdd929fef70>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:00.078533 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-54616739-7642-4cc8-a4b3-8db324dcdafc tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] HTTP exception thrown: Volume 5500f434-fb4b-4e41-b18e-1a0f9bb0328c could not be found. Feb 20 20:04:00.079321 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-54616739-7642-4cc8-a4b3-8db324dcdafc tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] Returning 404 to user: Volume 5500f434-fb4b-4e41-b18e-1a0f9bb0328c could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:04:00.080309 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-54616739-7642-4cc8-a4b3-8db324dcdafc tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/5500f434-fb4b-4e41-b18e-1a0f9bb0328c" status: 404 len: 109 microversion: 2.1 time: 0.086546 Feb 20 20:04:00.085295 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 15/37] 10.222.0.60 () {58 vars in 1247 bytes} [Sun Feb 20 20:03:59 2022] DELETE /compute/v2.1/os-volumes/5500f434-fb4b-4e41-b18e-1a0f9bb0328c => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:04:00.091086 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-081ff82a-e51f-422b-885d-1085b40eeb68 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:00.093392 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d1b8cf9c-ae32-42f8-bc23-c4cfff302d67 tempest-VolumesTestJSON-1476965542 tempest-VolumesTestJSON-1476965542-project] Calling method '.version_select at 0x7fdd9390d700>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:00.134211 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-081ff82a-e51f-422b-885d-1085b40eeb68 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1273 microversion: 2.1 time: 1.384638 Feb 20 20:04:00.148542 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 23/38] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:03:58 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1273 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:00.585860 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d1f5f3ec-6530-4b3d-a848-2ccd4e71e9a1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1468895411", "imageRef": "61c0cc70-53e3-40ed-b353-ec1b5fc4eea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:04:00.624579 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d1b8cf9c-ae32-42f8-bc23-c4cfff302d67 tempest-VolumesTestJSON-1476965542 tempest-VolumesTestJSON-1476965542-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.537645 Feb 20 20:04:00.626074 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 16/39] 10.222.0.60 () {58 vars in 1148 bytes} [Sun Feb 20 20:04:00 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:04:00.639729 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-50126313-8fa3-4677-b692-d8aa370e29ec tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] Calling method '.version_select at 0x7fdd9325f670>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:00.882926 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.network.neutron [None req-d1f5f3ec-6530-4b3d-a848-2ccd4e71e9a1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] validate_networks() for [('37567a22-fd4c-4456-b47a-a244d0fa7971', None, None, None, None, None)] {{(pid=117088) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 20 20:04:00.899444 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-50126313-8fa3-4677-b692-d8aa370e29ec tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] HTTP exception thrown: Volume 5500f434-fb4b-4e41-b18e-1a0f9bb0328c could not be found. Feb 20 20:04:00.900079 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-50126313-8fa3-4677-b692-d8aa370e29ec tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] Returning 404 to user: Volume 5500f434-fb4b-4e41-b18e-1a0f9bb0328c could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:04:00.901331 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-50126313-8fa3-4677-b692-d8aa370e29ec tempest-VolumesSnapshotsTestJSON-301093942 tempest-VolumesSnapshotsTestJSON-301093942-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/5500f434-fb4b-4e41-b18e-1a0f9bb0328c" status: 404 len: 109 microversion: 2.1 time: 0.273885 Feb 20 20:04:00.906648 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 17/40] 10.222.0.60 () {58 vars in 1244 bytes} [Sun Feb 20 20:04:00 2022] GET /compute/v2.1/os-volumes/5500f434-fb4b-4e41-b18e-1a0f9bb0328c => generated 109 bytes in 279 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:04:00.914434 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-18c82db5-c4dd-4161-86b4-0efa864f0483 tempest-VolumesTestJSON-1476965542 tempest-VolumesTestJSON-1476965542-project] Calling method '.version_select at 0x7fdd929feca0>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:01.126943 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-18c82db5-c4dd-4161-86b4-0efa864f0483 tempest-VolumesTestJSON-1476965542 tempest-VolumesTestJSON-1476965542-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.217908 Feb 20 20:04:01.128471 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 18/41] 10.222.0.60 () {58 vars in 1133 bytes} [Sun Feb 20 20:04:00 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:01.286906 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b805abbd-0d5e-48a3-93e9-b9c8197acfb2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Action: 'create', calling method: .version_select at 0x7fdd929fe4c0>, body: {"keypair": {"name": "tempest-keypair-2074067286"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:04:01.316395 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-b805abbd-0d5e-48a3-93e9-b9c8197acfb2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Getting quotas for project e1bbd53d77c94e618e7f59de051406ed. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:04:01.343896 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-b805abbd-0d5e-48a3-93e9-b9c8197acfb2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Getting quotas for user 5a2f5fd619ad45a48590fa6b2ae6fb4f and project e1bbd53d77c94e618e7f59de051406ed. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:04:01.662705 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-b805abbd-0d5e-48a3-93e9-b9c8197acfb2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Getting quotas for project e1bbd53d77c94e618e7f59de051406ed. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:04:01.667762 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-b805abbd-0d5e-48a3-93e9-b9c8197acfb2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Getting quotas for user 5a2f5fd619ad45a48590fa6b2ae6fb4f and project e1bbd53d77c94e618e7f59de051406ed. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:04:01.697384 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b805abbd-0d5e-48a3-93e9-b9c8197acfb2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.567711 Feb 20 20:04:01.707433 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 19/42] 10.222.0.60 () {62 vars in 1198 bytes} [Sun Feb 20 20:04:01 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 578 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 20 20:04:01.712706 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a7d9a7b0-3eb8-4e51-9aee-54a33a26ac38 tempest-VolumesTestJSON-1476965542 tempest-VolumesTestJSON-1476965542-project] Calling method '.version_select at 0x7fdd9390d430>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:02.010365 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a7d9a7b0-3eb8-4e51-9aee-54a33a26ac38 tempest-VolumesTestJSON-1476965542 tempest-VolumesTestJSON-1476965542-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.300254 Feb 20 20:04:02.011276 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 20/43] 10.222.0.60 () {58 vars in 1166 bytes} [Sun Feb 20 20:04:01 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:04:02.019903 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-781018d9-950e-4b18-b326-757636e62009 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:02.023086 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-781018d9-950e-4b18-b326-757636e62009 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:02.047154 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-781018d9-950e-4b18-b326-757636e62009 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:02.047613 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-781018d9-950e-4b18-b326-757636e62009 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:02.052349 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-781018d9-950e-4b18-b326-757636e62009 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:02.052860 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-781018d9-950e-4b18-b326-757636e62009 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:03.066561 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-781018d9-950e-4b18-b326-757636e62009 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:03.108128 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-781018d9-950e-4b18-b326-757636e62009 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1315 microversion: 2.1 time: 1.091589 Feb 20 20:04:03.108623 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 21/44] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:02 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1315 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:03.119417 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f43da46f-78a3-45c7-a165-41b4fbf0df7e tempest-VolumesTestJSON-1476965542 tempest-VolumesTestJSON-1476965542-project] Calling method '.version_select at 0x7fdd918e03a0>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:03.257771 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-d1f5f3ec-6530-4b3d-a848-2ccd4e71e9a1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Flavor limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 20 20:04:03.258836 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-d1f5f3ec-6530-4b3d-a848-2ccd4e71e9a1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Image limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 20 20:04:03.259493 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-d1f5f3ec-6530-4b3d-a848-2ccd4e71e9a1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Flavor pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 20 20:04:03.260063 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-d1f5f3ec-6530-4b3d-a848-2ccd4e71e9a1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Image pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 20 20:04:03.260660 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-d1f5f3ec-6530-4b3d-a848-2ccd4e71e9a1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 20 20:04:03.290762 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d1f5f3ec-6530-4b3d-a848-2ccd4e71e9a1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:03.291535 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d1f5f3ec-6530-4b3d-a848-2ccd4e71e9a1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:03.302333 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d1f5f3ec-6530-4b3d-a848-2ccd4e71e9a1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:03.304530 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d1f5f3ec-6530-4b3d-a848-2ccd4e71e9a1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:03.383605 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-d1f5f3ec-6530-4b3d-a848-2ccd4e71e9a1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Getting quotas for project 7c41f18c6d374064a28ac5b75141a0d3. Resources: {'instances', 'cores', 'ram'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:04:03.395699 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-d1f5f3ec-6530-4b3d-a848-2ccd4e71e9a1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Getting quotas for user c704da343000437aa514b8f807c1f2ef and project 7c41f18c6d374064a28ac5b75141a0d3. Resources: {'instances', 'cores', 'ram'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:04:03.433464 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d1f5f3ec-6530-4b3d-a848-2ccd4e71e9a1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Going to run 1 instances... {{(pid=117088) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 20 20:04:03.440119 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f43da46f-78a3-45c7-a165-41b4fbf0df7e tempest-VolumesTestJSON-1476965542 tempest-VolumesTestJSON-1476965542-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.330089 Feb 20 20:04:03.441361 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 22/45] 10.222.0.60 () {58 vars in 1169 bytes} [Sun Feb 20 20:04:03 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:04:03.448056 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d1f5f3ec-6530-4b3d-a848-2ccd4e71e9a1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61c0cc70-53e3-40ed-b353-ec1b5fc4eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 20 20:04:03.721679 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d1f5f3ec-6530-4b3d-a848-2ccd4e71e9a1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.571394 Feb 20 20:04:03.722740 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1146 bytes} [Sun Feb 20 20:04:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 3573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 20 20:04:03.727742 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d441e016-eb75-41f1-9986-7ec0238edceb tempest-VolumesTestJSON-1476965542 tempest-VolumesTestJSON-1476965542-project] Calling method '.version_select at 0x7fdd928f4820>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:03.812972 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2c96c7d0-468e-40f7-83b1-4fb7ef390e55 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Action: 'create', calling method: .version_select at 0x7fdd918e0ee0>, body: {"keypair": {"name": "tempest-keypair-362631716"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:04:03.845260 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-2c96c7d0-468e-40f7-83b1-4fb7ef390e55 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Getting quotas for project 27dde5e056c34a6a9fdf78ab276c3fc6. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:04:03.880613 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-2c96c7d0-468e-40f7-83b1-4fb7ef390e55 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Getting quotas for user aa60c0b71ba54f37b0a45b330f9683c9 and project 27dde5e056c34a6a9fdf78ab276c3fc6. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:04:04.049489 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d441e016-eb75-41f1-9986-7ec0238edceb tempest-VolumesTestJSON-1476965542 tempest-VolumesTestJSON-1476965542-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.325267 Feb 20 20:04:04.050627 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 25/47] 10.222.0.60 () {58 vars in 1154 bytes} [Sun Feb 20 20:04:03 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:04.056291 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8f327e7f-892d-4b6f-aa20-a387226ec5bf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:04.064037 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8f327e7f-892d-4b6f-aa20-a387226ec5bf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:04.219171 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8f327e7f-892d-4b6f-aa20-a387226ec5bf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:04.239086 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8f327e7f-892d-4b6f-aa20-a387226ec5bf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1222 microversion: 2.1 time: 0.186472 Feb 20 20:04:04.247375 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 26/48] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:04 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1222 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:04.252620 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-05c5f1a2-5341-4fc0-a97a-912bc1b1ec36 tempest-VolumesTestJSON-1476965542 tempest-VolumesTestJSON-1476965542-project] Calling method '.version_select at 0x7fdd92910820>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:04.505357 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-05c5f1a2-5341-4fc0-a97a-912bc1b1ec36 tempest-VolumesTestJSON-1476965542 tempest-VolumesTestJSON-1476965542-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.256659 Feb 20 20:04:04.506618 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 27/49] 10.222.0.60 () {58 vars in 1187 bytes} [Sun Feb 20 20:04:04 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:04:04.511159 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4db45c81-a96d-4af9-b4b9-35d7983aca18 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:04.514443 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4db45c81-a96d-4af9-b4b9-35d7983aca18 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:04.530545 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-2c96c7d0-468e-40f7-83b1-4fb7ef390e55 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Getting quotas for project 27dde5e056c34a6a9fdf78ab276c3fc6. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:04:04.537310 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4db45c81-a96d-4af9-b4b9-35d7983aca18 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:04.537917 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4db45c81-a96d-4af9-b4b9-35d7983aca18 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:04.538821 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-2c96c7d0-468e-40f7-83b1-4fb7ef390e55 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Getting quotas for user aa60c0b71ba54f37b0a45b330f9683c9 and project 27dde5e056c34a6a9fdf78ab276c3fc6. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:04:04.539646 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4db45c81-a96d-4af9-b4b9-35d7983aca18 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:04.540282 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4db45c81-a96d-4af9-b4b9-35d7983aca18 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:04.592831 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2c96c7d0-468e-40f7-83b1-4fb7ef390e55 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.145926 Feb 20 20:04:04.601598 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 23/50] 10.222.0.60 () {60 vars in 1157 bytes} [Sun Feb 20 20:04:03 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:04.617501 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9497d8c2-3efc-48ed-b561-16d79d2e075b tempest-VolumesTestJSON-1476965542 tempest-VolumesTestJSON-1476965542-project] Calling method '.version_select at 0x7fdd918f43a0>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:04.833653 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9497d8c2-3efc-48ed-b561-16d79d2e075b tempest-VolumesTestJSON-1476965542 tempest-VolumesTestJSON-1476965542-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.230094 Feb 20 20:04:04.834597 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 24/51] 10.222.0.60 () {58 vars in 1154 bytes} [Sun Feb 20 20:04:04 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:04.840447 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-47e6ef5a-5b90-456d-9854-eeae6283356e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-720212605", "imageRef": "61c0cc70-53e3-40ed-b353-ec1b5fc4eea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:04:05.021332 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.network.neutron [None req-47e6ef5a-5b90-456d-9854-eeae6283356e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] validate_networks() for [('37567a22-fd4c-4456-b47a-a244d0fa7971', None, None, None, None, None)] {{(pid=117087) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 20 20:04:06.189305 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4db45c81-a96d-4af9-b4b9-35d7983aca18 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:06.241811 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4db45c81-a96d-4af9-b4b9-35d7983aca18 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1315 microversion: 2.1 time: 1.732696 Feb 20 20:04:06.242785 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 28/52] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:04 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1315 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:07.261324 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-67db1d71-20d1-4dde-a742-130f67c74f9d tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:07.262670 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-67db1d71-20d1-4dde-a742-130f67c74f9d tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:07.284204 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-67db1d71-20d1-4dde-a742-130f67c74f9d tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:07.285778 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-67db1d71-20d1-4dde-a742-130f67c74f9d tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:07.294250 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-67db1d71-20d1-4dde-a742-130f67c74f9d tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:07.294816 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-67db1d71-20d1-4dde-a742-130f67c74f9d tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:07.660426 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-47e6ef5a-5b90-456d-9854-eeae6283356e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Flavor limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 20 20:04:07.662922 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-47e6ef5a-5b90-456d-9854-eeae6283356e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Image limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 20 20:04:07.663558 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-47e6ef5a-5b90-456d-9854-eeae6283356e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Flavor pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 20 20:04:07.664133 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-47e6ef5a-5b90-456d-9854-eeae6283356e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Image pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 20 20:04:07.664692 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-47e6ef5a-5b90-456d-9854-eeae6283356e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 20 20:04:07.679519 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-47e6ef5a-5b90-456d-9854-eeae6283356e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:07.679942 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-47e6ef5a-5b90-456d-9854-eeae6283356e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:07.680759 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-47e6ef5a-5b90-456d-9854-eeae6283356e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:07.681252 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-47e6ef5a-5b90-456d-9854-eeae6283356e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:07.754124 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-47e6ef5a-5b90-456d-9854-eeae6283356e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Getting quotas for project 7c41f18c6d374064a28ac5b75141a0d3. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:04:07.776267 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-47e6ef5a-5b90-456d-9854-eeae6283356e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Getting quotas for user c704da343000437aa514b8f807c1f2ef and project 7c41f18c6d374064a28ac5b75141a0d3. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:04:07.794899 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-47e6ef5a-5b90-456d-9854-eeae6283356e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Going to run 1 instances... {{(pid=117087) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 20 20:04:07.798374 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-47e6ef5a-5b90-456d-9854-eeae6283356e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61c0cc70-53e3-40ed-b353-ec1b5fc4eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 20 20:04:08.005498 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-47e6ef5a-5b90-456d-9854-eeae6283356e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.169620 Feb 20 20:04:08.018442 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 25/53] 10.222.0.60 () {60 vars in 1146 bytes} [Sun Feb 20 20:04:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 3183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 20 20:04:08.025780 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ec6719cc-6898-4522-acf8-c3c31e5116f4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1750717948", "imageRef": "61c0cc70-53e3-40ed-b353-ec1b5fc4eea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "628a481f-f881-4fc8-9417-12ed3960094e"}], "security_groups": [{"name": "tempest-securitygroup--2014237498"}], "key_name": "tempest-keypair-2074067286", "user_data": "}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:04:08.237150 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-67db1d71-20d1-4dde-a742-130f67c74f9d tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:08.261366 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-67db1d71-20d1-4dde-a742-130f67c74f9d tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1315 microversion: 2.1 time: 1.005197 Feb 20 20:04:08.283240 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 29/54] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:07 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1315 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:04:08.323453 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4f5bc781-ab53-49d6-b4b6-252cc9a158aa tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:08.323453 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4f5bc781-ab53-49d6-b4b6-252cc9a158aa tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:08.580030 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4f5bc781-ab53-49d6-b4b6-252cc9a158aa tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:08.591240 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4f5bc781-ab53-49d6-b4b6-252cc9a158aa tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1221 microversion: 2.1 time: 0.304497 Feb 20 20:04:08.596228 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 30/55] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:08 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1221 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:08.627786 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.network.neutron [None req-ec6719cc-6898-4522-acf8-c3c31e5116f4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] validate_networks() for [('628a481f-f881-4fc8-9417-12ed3960094e', None, None, None, None, None)] {{(pid=117087) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 20 20:04:08.955945 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-60f15f34-cea9-4111-83d3-99d5d58eca91 req-d3623634-85e3-4db4-8ba2-0962be93c53c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27be4751-a3cc-4912-8cc9-fb61d611698d", "tag": "d256f7e8-1d52-4116-97eb-a03ae94013f4"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:04:08.963233 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:04:08.963233 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:04:08.989270 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-60f15f34-cea9-4111-83d3-99d5d58eca91 req-d3623634-85e3-4db4-8ba2-0962be93c53c service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:08.990118 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-60f15f34-cea9-4111-83d3-99d5d58eca91 req-d3623634-85e3-4db4-8ba2-0962be93c53c service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:09.103598 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-60f15f34-cea9-4111-83d3-99d5d58eca91 req-d3623634-85e3-4db4-8ba2-0962be93c53c service nova] Creating event network-changed:d256f7e8-1d52-4116-97eb-a03ae94013f4 for instance 27be4751-a3cc-4912-8cc9-fb61d611698d on hv-cinder-83008 Feb 20 20:04:09.104159 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-60f15f34-cea9-4111-83d3-99d5d58eca91 req-d3623634-85e3-4db4-8ba2-0962be93c53c service nova] Acquired lock "compute-rpcapi-router" {{(pid=117088) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 20 20:04:09.105375 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-79fd83c8-8f3e-4132-b5ee-98cf16d0df6a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:09.105824 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-79fd83c8-8f3e-4132-b5ee-98cf16d0df6a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:09.106626 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-79fd83c8-8f3e-4132-b5ee-98cf16d0df6a None None] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:09.107066 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-79fd83c8-8f3e-4132-b5ee-98cf16d0df6a None None] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:09.154608 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.compute.rpcapi [None req-79fd83c8-8f3e-4132-b5ee-98cf16d0df6a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 20 20:04:09.159352 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-79fd83c8-8f3e-4132-b5ee-98cf16d0df6a None None] Releasing lock "compute-rpcapi-router" {{(pid=117088) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 20 20:04:09.227134 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-79fd83c8-8f3e-4132-b5ee-98cf16d0df6a None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.610800 Feb 20 20:04:09.228038 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 31/56] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:04:09.288924 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-41b6436d-dc9b-42ad-a23f-4f7d9211a467 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:09.289650 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-41b6436d-dc9b-42ad-a23f-4f7d9211a467 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:09.308139 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-41b6436d-dc9b-42ad-a23f-4f7d9211a467 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:09.308139 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-41b6436d-dc9b-42ad-a23f-4f7d9211a467 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:09.308139 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-41b6436d-dc9b-42ad-a23f-4f7d9211a467 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:09.318889 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-41b6436d-dc9b-42ad-a23f-4f7d9211a467 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:09.671782 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-ec6719cc-6898-4522-acf8-c3c31e5116f4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Flavor limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 20 20:04:09.672271 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-ec6719cc-6898-4522-acf8-c3c31e5116f4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Image limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 20 20:04:09.674025 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-ec6719cc-6898-4522-acf8-c3c31e5116f4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Flavor pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 20 20:04:09.674654 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-ec6719cc-6898-4522-acf8-c3c31e5116f4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Image pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 20 20:04:09.675696 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-ec6719cc-6898-4522-acf8-c3c31e5116f4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 20 20:04:09.684612 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-41b6436d-dc9b-42ad-a23f-4f7d9211a467 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:09.697192 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ec6719cc-6898-4522-acf8-c3c31e5116f4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:09.697868 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ec6719cc-6898-4522-acf8-c3c31e5116f4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:09.698861 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ec6719cc-6898-4522-acf8-c3c31e5116f4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:09.699570 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ec6719cc-6898-4522-acf8-c3c31e5116f4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:09.708052 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-41b6436d-dc9b-42ad-a23f-4f7d9211a467 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1315 microversion: 2.1 time: 0.422280 Feb 20 20:04:09.709167 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 32/57] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:09 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:09.715574 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9756022b-71a5-426e-9e50-2307cebeb500 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:09.716457 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9756022b-71a5-426e-9e50-2307cebeb500 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:09.721053 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-ec6719cc-6898-4522-acf8-c3c31e5116f4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Getting quotas for project e1bbd53d77c94e618e7f59de051406ed. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:04:09.725541 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9756022b-71a5-426e-9e50-2307cebeb500 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:09.725777 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-ec6719cc-6898-4522-acf8-c3c31e5116f4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Getting quotas for user 5a2f5fd619ad45a48590fa6b2ae6fb4f and project e1bbd53d77c94e618e7f59de051406ed. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:04:09.726644 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9756022b-71a5-426e-9e50-2307cebeb500 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:09.727657 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9756022b-71a5-426e-9e50-2307cebeb500 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:09.728195 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9756022b-71a5-426e-9e50-2307cebeb500 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:09.743820 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ec6719cc-6898-4522-acf8-c3c31e5116f4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Going to run 1 instances... {{(pid=117087) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 20 20:04:09.747628 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ec6719cc-6898-4522-acf8-c3c31e5116f4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61c0cc70-53e3-40ed-b353-ec1b5fc4eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 20 20:04:09.803403 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9756022b-71a5-426e-9e50-2307cebeb500 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:09.813053 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9756022b-71a5-426e-9e50-2307cebeb500 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1225 microversion: 2.1 time: 0.102650 Feb 20 20:04:09.814531 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 33/58] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:09 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:09.900551 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ec6719cc-6898-4522-acf8-c3c31e5116f4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.878204 Feb 20 20:04:09.900551 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 26/59] 10.222.0.60 () {62 vars in 1187 bytes} [Sun Feb 20 20:04:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 1880 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 20 20:04:09.909518 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c8f86628-f6c3-468a-b595-c8c79790e1c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:09.910390 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c8f86628-f6c3-468a-b595-c8c79790e1c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:10.023777 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c8f86628-f6c3-468a-b595-c8c79790e1c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:10.031328 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c8f86628-f6c3-468a-b595-c8c79790e1c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:10.037914 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c8f86628-f6c3-468a-b595-c8c79790e1c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:10.044811 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c8f86628-f6c3-468a-b595-c8c79790e1c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1282 microversion: 2.20 time: 0.133888 Feb 20 20:04:10.047794 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 34/60] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:09 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1282 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:04:10.344951 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-bbb35ae9-ad9b-4780-b5bd-ef80a7066cb1 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-779438184", "imageRef": "61c0cc70-53e3-40ed-b353-ec1b5fc4eea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "071c382c-ea33-42d9-9b4c-49dc8158480b"}], "security_groups": [{"name": "tempest-securitygroup--1637407339"}], "key_name": "tempest-keypair-362631716", "user_data": "}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:04:10.463367 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.network.neutron [None req-bbb35ae9-ad9b-4780-b5bd-ef80a7066cb1 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] validate_networks() for [('071c382c-ea33-42d9-9b4c-49dc8158480b', None, None, None, None, None)] {{(pid=117087) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 20 20:04:10.726545 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c1ccc9e5-dd21-4b7e-8561-f7ac6affcfd0 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:10.727170 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c1ccc9e5-dd21-4b7e-8561-f7ac6affcfd0 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:10.734494 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c1ccc9e5-dd21-4b7e-8561-f7ac6affcfd0 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:10.734946 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c1ccc9e5-dd21-4b7e-8561-f7ac6affcfd0 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:10.735748 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c1ccc9e5-dd21-4b7e-8561-f7ac6affcfd0 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:10.736180 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c1ccc9e5-dd21-4b7e-8561-f7ac6affcfd0 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:10.988994 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-bbb35ae9-ad9b-4780-b5bd-ef80a7066cb1 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Flavor limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 20 20:04:10.989820 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-bbb35ae9-ad9b-4780-b5bd-ef80a7066cb1 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Image limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 20 20:04:10.989982 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-bbb35ae9-ad9b-4780-b5bd-ef80a7066cb1 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Flavor pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 20 20:04:11.000877 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-bbb35ae9-ad9b-4780-b5bd-ef80a7066cb1 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Image pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 20 20:04:11.001489 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-bbb35ae9-ad9b-4780-b5bd-ef80a7066cb1 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 20 20:04:11.037422 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bbb35ae9-ad9b-4780-b5bd-ef80a7066cb1 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:11.038265 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bbb35ae9-ad9b-4780-b5bd-ef80a7066cb1 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:11.039534 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bbb35ae9-ad9b-4780-b5bd-ef80a7066cb1 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:11.040193 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bbb35ae9-ad9b-4780-b5bd-ef80a7066cb1 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:11.074952 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c1ccc9e5-dd21-4b7e-8561-f7ac6affcfd0 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:11.084767 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c1ccc9e5-dd21-4b7e-8561-f7ac6affcfd0 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1315 microversion: 2.1 time: 0.361746 Feb 20 20:04:11.098772 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 35/61] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:10 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:04:11.098965 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-bbb35ae9-ad9b-4780-b5bd-ef80a7066cb1 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Getting quotas for project 27dde5e056c34a6a9fdf78ab276c3fc6. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:04:11.100173 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-bbb35ae9-ad9b-4780-b5bd-ef80a7066cb1 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Getting quotas for user aa60c0b71ba54f37b0a45b330f9683c9 and project 27dde5e056c34a6a9fdf78ab276c3fc6. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:04:11.104017 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b4b8f533-5d67-4a85-885a-9d20d92fea14 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:11.111869 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b4b8f533-5d67-4a85-885a-9d20d92fea14 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:11.148800 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-bbb35ae9-ad9b-4780-b5bd-ef80a7066cb1 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Going to run 1 instances... {{(pid=117087) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 20 20:04:11.159093 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-bbb35ae9-ad9b-4780-b5bd-ef80a7066cb1 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61c0cc70-53e3-40ed-b353-ec1b5fc4eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 20 20:04:11.170840 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b4b8f533-5d67-4a85-885a-9d20d92fea14 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:11.171332 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b4b8f533-5d67-4a85-885a-9d20d92fea14 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:11.172158 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b4b8f533-5d67-4a85-885a-9d20d92fea14 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:11.179967 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b4b8f533-5d67-4a85-885a-9d20d92fea14 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:11.330866 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b4b8f533-5d67-4a85-885a-9d20d92fea14 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:11.345307 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b4b8f533-5d67-4a85-885a-9d20d92fea14 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1225 microversion: 2.1 time: 0.253898 Feb 20 20:04:11.346415 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 36/62] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:11 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1225 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:11.381737 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7caa620e-e172-4b64-8fcb-0f3a553d275b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:11.385029 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-bbb35ae9-ad9b-4780-b5bd-ef80a7066cb1 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.046588 Feb 20 20:04:11.387810 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 27/63] 10.222.0.60 () {60 vars in 1146 bytes} [Sun Feb 20 20:04:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 20 20:04:11.396493 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7caa620e-e172-4b64-8fcb-0f3a553d275b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:11.405918 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d8571d25-579f-4fd2-b4fc-eaa15ff4bbdb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:11.407957 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d8571d25-579f-4fd2-b4fc-eaa15ff4bbdb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:11.434576 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7caa620e-e172-4b64-8fcb-0f3a553d275b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:11.442977 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7caa620e-e172-4b64-8fcb-0f3a553d275b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:11.444701 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7caa620e-e172-4b64-8fcb-0f3a553d275b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:11.448323 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7caa620e-e172-4b64-8fcb-0f3a553d275b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:12.036152 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d8571d25-579f-4fd2-b4fc-eaa15ff4bbdb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:12.070462 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d8571d25-579f-4fd2-b4fc-eaa15ff4bbdb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1236 microversion: 2.1 time: 0.671852 Feb 20 20:04:12.072703 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 28/64] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:11 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1236 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:12.105457 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ec548a46-7f1f-4599-9fef-370c3b5e9dbd tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:12.106249 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ec548a46-7f1f-4599-9fef-370c3b5e9dbd tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:12.118946 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ec548a46-7f1f-4599-9fef-370c3b5e9dbd tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:12.119808 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ec548a46-7f1f-4599-9fef-370c3b5e9dbd tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:12.120900 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ec548a46-7f1f-4599-9fef-370c3b5e9dbd tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:12.121556 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ec548a46-7f1f-4599-9fef-370c3b5e9dbd tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:12.127389 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7caa620e-e172-4b64-8fcb-0f3a553d275b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:12.152969 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7caa620e-e172-4b64-8fcb-0f3a553d275b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:12.161828 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7caa620e-e172-4b64-8fcb-0f3a553d275b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:12.163074 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7caa620e-e172-4b64-8fcb-0f3a553d275b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1286 microversion: 2.20 time: 0.803291 Feb 20 20:04:12.163656 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 37/65] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:11 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1286 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:04:12.366118 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-81e858ee-ba8b-4a35-853b-be657e573884 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:12.367868 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-81e858ee-ba8b-4a35-853b-be657e573884 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:12.386804 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-81e858ee-ba8b-4a35-853b-be657e573884 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:12.387573 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-81e858ee-ba8b-4a35-853b-be657e573884 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:12.390660 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-81e858ee-ba8b-4a35-853b-be657e573884 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:12.392787 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-81e858ee-ba8b-4a35-853b-be657e573884 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:12.596040 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-81e858ee-ba8b-4a35-853b-be657e573884 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:12.612528 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-81e858ee-ba8b-4a35-853b-be657e573884 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1273 microversion: 2.1 time: 0.250988 Feb 20 20:04:12.622421 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 38/66] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:12 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1273 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:12.693411 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ec548a46-7f1f-4599-9fef-370c3b5e9dbd tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:12.697048 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ec548a46-7f1f-4599-9fef-370c3b5e9dbd tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1315 microversion: 2.1 time: 0.595353 Feb 20 20:04:12.708719 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 29/67] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:12 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1315 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:04:13.097327 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c57b80ef-f0c0-4277-b04c-e36427cad09d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:13.100972 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c57b80ef-f0c0-4277-b04c-e36427cad09d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:13.138079 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c57b80ef-f0c0-4277-b04c-e36427cad09d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:13.145960 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c57b80ef-f0c0-4277-b04c-e36427cad09d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:13.150050 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c57b80ef-f0c0-4277-b04c-e36427cad09d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:13.152395 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c57b80ef-f0c0-4277-b04c-e36427cad09d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:13.188432 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7b85abdd-7415-4bfb-94d7-ddc18c7ab1ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:13.189406 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7b85abdd-7415-4bfb-94d7-ddc18c7ab1ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:13.199956 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7b85abdd-7415-4bfb-94d7-ddc18c7ab1ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:13.200729 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7b85abdd-7415-4bfb-94d7-ddc18c7ab1ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:13.201784 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7b85abdd-7415-4bfb-94d7-ddc18c7ab1ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:13.202480 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7b85abdd-7415-4bfb-94d7-ddc18c7ab1ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:13.419649 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7b85abdd-7415-4bfb-94d7-ddc18c7ab1ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:13.439164 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7b85abdd-7415-4bfb-94d7-ddc18c7ab1ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:13.444759 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c57b80ef-f0c0-4277-b04c-e36427cad09d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:13.453571 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c57b80ef-f0c0-4277-b04c-e36427cad09d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1240 microversion: 2.1 time: 0.365123 Feb 20 20:04:13.458384 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7b85abdd-7415-4bfb-94d7-ddc18c7ab1ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:13.459543 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7b85abdd-7415-4bfb-94d7-ddc18c7ab1ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1334 microversion: 2.20 time: 0.277117 Feb 20 20:04:13.460104 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 30/68] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:13 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1334 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:04:13.460505 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 39/69] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:13 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1240 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:13.638464 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-288b2dde-e4f5-4139-a8e8-ce6d3dbf7454 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:13.639599 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-288b2dde-e4f5-4139-a8e8-ce6d3dbf7454 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:13.662698 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-288b2dde-e4f5-4139-a8e8-ce6d3dbf7454 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:13.666986 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-288b2dde-e4f5-4139-a8e8-ce6d3dbf7454 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:13.678811 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-288b2dde-e4f5-4139-a8e8-ce6d3dbf7454 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:13.682842 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-288b2dde-e4f5-4139-a8e8-ce6d3dbf7454 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:13.736685 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d0dbd134-eb1a-49a9-b7e3-320f93a41e31 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:13.738062 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d0dbd134-eb1a-49a9-b7e3-320f93a41e31 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:13.746338 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d0dbd134-eb1a-49a9-b7e3-320f93a41e31 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:13.747216 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d0dbd134-eb1a-49a9-b7e3-320f93a41e31 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:13.750171 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d0dbd134-eb1a-49a9-b7e3-320f93a41e31 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:13.750822 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d0dbd134-eb1a-49a9-b7e3-320f93a41e31 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:13.825033 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-288b2dde-e4f5-4139-a8e8-ce6d3dbf7454 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:13.839476 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-288b2dde-e4f5-4139-a8e8-ce6d3dbf7454 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1281 microversion: 2.1 time: 0.204522 Feb 20 20:04:13.842396 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 40/70] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:13 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1281 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:13.999527 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d0dbd134-eb1a-49a9-b7e3-320f93a41e31 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:14.007811 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d0dbd134-eb1a-49a9-b7e3-320f93a41e31 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1315 microversion: 2.1 time: 0.285680 Feb 20 20:04:14.008969 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 31/71] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:13 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:14.473468 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f3128197-bcdf-4373-b7d5-ffa36d0dfe66 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:14.475160 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f3128197-bcdf-4373-b7d5-ffa36d0dfe66 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:14.478539 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a40c06b5-b64d-40f6-b35f-d6e20c419fe7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:14.479148 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a40c06b5-b64d-40f6-b35f-d6e20c419fe7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:14.486076 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a40c06b5-b64d-40f6-b35f-d6e20c419fe7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:14.487757 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f3128197-bcdf-4373-b7d5-ffa36d0dfe66 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:14.488212 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f3128197-bcdf-4373-b7d5-ffa36d0dfe66 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:14.489013 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f3128197-bcdf-4373-b7d5-ffa36d0dfe66 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:14.489482 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f3128197-bcdf-4373-b7d5-ffa36d0dfe66 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:14.489694 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a40c06b5-b64d-40f6-b35f-d6e20c419fe7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:14.490463 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a40c06b5-b64d-40f6-b35f-d6e20c419fe7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:14.490917 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a40c06b5-b64d-40f6-b35f-d6e20c419fe7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:14.631707 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a40c06b5-b64d-40f6-b35f-d6e20c419fe7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:14.655259 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a40c06b5-b64d-40f6-b35f-d6e20c419fe7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:14.660845 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a40c06b5-b64d-40f6-b35f-d6e20c419fe7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:14.662979 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a40c06b5-b64d-40f6-b35f-d6e20c419fe7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1342 microversion: 2.20 time: 0.188324 Feb 20 20:04:14.666131 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 32/72] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:14 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1342 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:04:14.689887 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f3128197-bcdf-4373-b7d5-ffa36d0dfe66 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:14.701885 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f3128197-bcdf-4373-b7d5-ffa36d0dfe66 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1232 microversion: 2.1 time: 0.232258 Feb 20 20:04:14.706077 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 41/73] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:14 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1232 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:14.859274 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b54962a6-df07-4c7d-956a-51b7d281ad0f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:14.860168 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b54962a6-df07-4c7d-956a-51b7d281ad0f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:14.869471 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b54962a6-df07-4c7d-956a-51b7d281ad0f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:14.870001 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b54962a6-df07-4c7d-956a-51b7d281ad0f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:14.870800 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b54962a6-df07-4c7d-956a-51b7d281ad0f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:14.871275 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b54962a6-df07-4c7d-956a-51b7d281ad0f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:15.001456 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b54962a6-df07-4c7d-956a-51b7d281ad0f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:15.021076 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b54962a6-df07-4c7d-956a-51b7d281ad0f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1291 microversion: 2.1 time: 0.155031 Feb 20 20:04:15.021076 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 33/74] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:14 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1291 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:15.025915 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0f834fce-8f8e-4e4b-8de1-152d313b2175 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:15.026650 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-0f834fce-8f8e-4e4b-8de1-152d313b2175 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:15.034536 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0f834fce-8f8e-4e4b-8de1-152d313b2175 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:15.035096 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0f834fce-8f8e-4e4b-8de1-152d313b2175 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:15.036053 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0f834fce-8f8e-4e4b-8de1-152d313b2175 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:15.036720 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0f834fce-8f8e-4e4b-8de1-152d313b2175 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:15.319531 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0f834fce-8f8e-4e4b-8de1-152d313b2175 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:15.335240 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-0f834fce-8f8e-4e4b-8de1-152d313b2175 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1315 microversion: 2.1 time: 0.312957 Feb 20 20:04:15.342820 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 42/75] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:15 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:15.691953 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8af003f4-62bd-4e42-98d8-c1d89d5d8cb2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:15.693516 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8af003f4-62bd-4e42-98d8-c1d89d5d8cb2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:15.699605 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8af003f4-62bd-4e42-98d8-c1d89d5d8cb2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:15.700061 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8af003f4-62bd-4e42-98d8-c1d89d5d8cb2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:15.704686 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8af003f4-62bd-4e42-98d8-c1d89d5d8cb2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:15.704686 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8af003f4-62bd-4e42-98d8-c1d89d5d8cb2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:15.723495 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-74f65632-ce3b-4c98-a149-06893e286bae tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:15.724217 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-74f65632-ce3b-4c98-a149-06893e286bae tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:15.730596 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-74f65632-ce3b-4c98-a149-06893e286bae tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:15.731125 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-74f65632-ce3b-4c98-a149-06893e286bae tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:15.750112 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-74f65632-ce3b-4c98-a149-06893e286bae tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:15.750797 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-74f65632-ce3b-4c98-a149-06893e286bae tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:15.772825 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8af003f4-62bd-4e42-98d8-c1d89d5d8cb2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:15.781498 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8af003f4-62bd-4e42-98d8-c1d89d5d8cb2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:15.783022 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8af003f4-62bd-4e42-98d8-c1d89d5d8cb2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:15.784142 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8af003f4-62bd-4e42-98d8-c1d89d5d8cb2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1342 microversion: 2.20 time: 0.106029 Feb 20 20:04:15.784709 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 34/76] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:15 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1342 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:04:15.853663 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-74f65632-ce3b-4c98-a149-06893e286bae tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:15.861977 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-74f65632-ce3b-4c98-a149-06893e286bae tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1288 microversion: 2.1 time: 0.142158 Feb 20 20:04:15.862546 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 43/77] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:15 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1288 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:16.032626 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7fb963f3-d041-4f40-95f5-8792e16642dc tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:16.032626 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7fb963f3-d041-4f40-95f5-8792e16642dc tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:16.039201 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7fb963f3-d041-4f40-95f5-8792e16642dc tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:16.050265 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7fb963f3-d041-4f40-95f5-8792e16642dc tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:16.050265 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7fb963f3-d041-4f40-95f5-8792e16642dc tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:16.050265 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7fb963f3-d041-4f40-95f5-8792e16642dc tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:16.123429 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7fb963f3-d041-4f40-95f5-8792e16642dc tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:16.132124 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7fb963f3-d041-4f40-95f5-8792e16642dc tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1279 microversion: 2.1 time: 0.104514 Feb 20 20:04:16.143885 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 35/78] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:16 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1279 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:16.369952 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-498b8980-6b49-472e-ab4d-34e9c1ad9d64 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:16.370560 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-498b8980-6b49-472e-ab4d-34e9c1ad9d64 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:16.376608 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-498b8980-6b49-472e-ab4d-34e9c1ad9d64 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:16.377290 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-498b8980-6b49-472e-ab4d-34e9c1ad9d64 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:16.378082 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-498b8980-6b49-472e-ab4d-34e9c1ad9d64 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:16.378520 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-498b8980-6b49-472e-ab4d-34e9c1ad9d64 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:16.518046 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-498b8980-6b49-472e-ab4d-34e9c1ad9d64 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:16.525692 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-498b8980-6b49-472e-ab4d-34e9c1ad9d64 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1315 microversion: 2.1 time: 0.159400 Feb 20 20:04:16.526295 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 44/79] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:16 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:16.801463 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ff837126-f190-4d4f-b41f-97e2a284c5e4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:16.802083 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ff837126-f190-4d4f-b41f-97e2a284c5e4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:16.808179 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ff837126-f190-4d4f-b41f-97e2a284c5e4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:16.808625 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ff837126-f190-4d4f-b41f-97e2a284c5e4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:16.809600 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ff837126-f190-4d4f-b41f-97e2a284c5e4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:16.810106 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ff837126-f190-4d4f-b41f-97e2a284c5e4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:16.879885 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8a02066a-6900-42ec-8c84-1bcdc6cc7ac4 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:16.881058 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8a02066a-6900-42ec-8c84-1bcdc6cc7ac4 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:16.882716 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ff837126-f190-4d4f-b41f-97e2a284c5e4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:16.887809 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8a02066a-6900-42ec-8c84-1bcdc6cc7ac4 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:16.889080 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8a02066a-6900-42ec-8c84-1bcdc6cc7ac4 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:16.890168 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8a02066a-6900-42ec-8c84-1bcdc6cc7ac4 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:16.890727 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8a02066a-6900-42ec-8c84-1bcdc6cc7ac4 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:16.892419 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ff837126-f190-4d4f-b41f-97e2a284c5e4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:16.894196 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ff837126-f190-4d4f-b41f-97e2a284c5e4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:16.895301 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ff837126-f190-4d4f-b41f-97e2a284c5e4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1342 microversion: 2.20 time: 0.097607 Feb 20 20:04:16.896066 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 36/80] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:16 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1342 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:04:16.957940 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8a02066a-6900-42ec-8c84-1bcdc6cc7ac4 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:16.966533 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8a02066a-6900-42ec-8c84-1bcdc6cc7ac4 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1288 microversion: 2.1 time: 0.090303 Feb 20 20:04:16.967833 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 45/81] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:16 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1288 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:17.151339 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-50dc2676-a812-4543-952b-13789fb4ce8e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:17.151959 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-50dc2676-a812-4543-952b-13789fb4ce8e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:17.158073 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-50dc2676-a812-4543-952b-13789fb4ce8e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:17.158531 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-50dc2676-a812-4543-952b-13789fb4ce8e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:17.159335 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-50dc2676-a812-4543-952b-13789fb4ce8e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:17.159775 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-50dc2676-a812-4543-952b-13789fb4ce8e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:17.222978 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-50dc2676-a812-4543-952b-13789fb4ce8e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:17.230794 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-50dc2676-a812-4543-952b-13789fb4ce8e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1279 microversion: 2.1 time: 0.083067 Feb 20 20:04:17.231412 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 37/82] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:17 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1279 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:17.542982 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-76691909-aefe-45c7-9b0a-734342da1a11 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:17.543838 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-76691909-aefe-45c7-9b0a-734342da1a11 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:17.549905 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-76691909-aefe-45c7-9b0a-734342da1a11 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:17.550408 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-76691909-aefe-45c7-9b0a-734342da1a11 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:17.551212 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-76691909-aefe-45c7-9b0a-734342da1a11 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:17.551652 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-76691909-aefe-45c7-9b0a-734342da1a11 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:17.734145 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-76691909-aefe-45c7-9b0a-734342da1a11 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:17.742435 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-76691909-aefe-45c7-9b0a-734342da1a11 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1315 microversion: 2.1 time: 0.203052 Feb 20 20:04:17.743136 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 46/83] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:17 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:17.915264 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-adfd2547-6229-433f-8b0c-7a1e0ff5863a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:17.915987 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-adfd2547-6229-433f-8b0c-7a1e0ff5863a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:17.923004 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-adfd2547-6229-433f-8b0c-7a1e0ff5863a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:17.923457 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-adfd2547-6229-433f-8b0c-7a1e0ff5863a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:17.927538 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-adfd2547-6229-433f-8b0c-7a1e0ff5863a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:17.927538 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-adfd2547-6229-433f-8b0c-7a1e0ff5863a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:17.984010 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6765601e-41be-41b4-9b8e-ad838244b3a0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:17.984704 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6765601e-41be-41b4-9b8e-ad838244b3a0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:17.991289 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6765601e-41be-41b4-9b8e-ad838244b3a0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:17.991813 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6765601e-41be-41b4-9b8e-ad838244b3a0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:17.992661 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6765601e-41be-41b4-9b8e-ad838244b3a0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:17.993201 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6765601e-41be-41b4-9b8e-ad838244b3a0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:17.999607 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-adfd2547-6229-433f-8b0c-7a1e0ff5863a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:18.008776 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-adfd2547-6229-433f-8b0c-7a1e0ff5863a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:18.010576 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-adfd2547-6229-433f-8b0c-7a1e0ff5863a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:18.015660 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-adfd2547-6229-433f-8b0c-7a1e0ff5863a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1342 microversion: 2.20 time: 0.101640 Feb 20 20:04:18.016284 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 38/84] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:17 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1342 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:04:18.055838 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6765601e-41be-41b4-9b8e-ad838244b3a0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:18.064089 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6765601e-41be-41b4-9b8e-ad838244b3a0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1288 microversion: 2.1 time: 0.083918 Feb 20 20:04:18.064657 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 47/85] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:17 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1288 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:18.247518 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-65efebcf-10a4-4ea9-aa8f-02e5d1ec6afb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:18.248664 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-65efebcf-10a4-4ea9-aa8f-02e5d1ec6afb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:18.254345 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-65efebcf-10a4-4ea9-aa8f-02e5d1ec6afb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:18.254783 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-65efebcf-10a4-4ea9-aa8f-02e5d1ec6afb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:18.264921 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-65efebcf-10a4-4ea9-aa8f-02e5d1ec6afb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:18.264921 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-65efebcf-10a4-4ea9-aa8f-02e5d1ec6afb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:18.321406 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-65efebcf-10a4-4ea9-aa8f-02e5d1ec6afb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:18.329005 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-65efebcf-10a4-4ea9-aa8f-02e5d1ec6afb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1279 microversion: 2.1 time: 0.085150 Feb 20 20:04:18.329612 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 39/86] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:18 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1279 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:18.769238 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-60a7f7a1-ab9d-4a1b-9be4-c5fff82f3664 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:18.769238 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-60a7f7a1-ab9d-4a1b-9be4-c5fff82f3664 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:18.775695 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-60a7f7a1-ab9d-4a1b-9be4-c5fff82f3664 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:18.777311 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-60a7f7a1-ab9d-4a1b-9be4-c5fff82f3664 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:18.779880 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-60a7f7a1-ab9d-4a1b-9be4-c5fff82f3664 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:18.780593 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-60a7f7a1-ab9d-4a1b-9be4-c5fff82f3664 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:19.034073 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8a2e3076-038a-4e3c-b5eb-f40998c7bd17 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:19.035112 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8a2e3076-038a-4e3c-b5eb-f40998c7bd17 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:19.042227 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8a2e3076-038a-4e3c-b5eb-f40998c7bd17 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:19.042674 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8a2e3076-038a-4e3c-b5eb-f40998c7bd17 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:19.043471 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8a2e3076-038a-4e3c-b5eb-f40998c7bd17 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:19.043914 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8a2e3076-038a-4e3c-b5eb-f40998c7bd17 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:19.448378 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8a2e3076-038a-4e3c-b5eb-f40998c7bd17 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:19.457122 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8a2e3076-038a-4e3c-b5eb-f40998c7bd17 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:19.461241 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8a2e3076-038a-4e3c-b5eb-f40998c7bd17 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:19.462684 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8a2e3076-038a-4e3c-b5eb-f40998c7bd17 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1342 microversion: 2.20 time: 0.432380 Feb 20 20:04:19.463298 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 40/87] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:19 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1342 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:04:19.474436 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-60a7f7a1-ab9d-4a1b-9be4-c5fff82f3664 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:19.479821 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a0ac71b0-0427-402b-a2e8-55c666ae929c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:19.480597 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a0ac71b0-0427-402b-a2e8-55c666ae929c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:19.481849 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-60a7f7a1-ab9d-4a1b-9be4-c5fff82f3664 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1315 microversion: 2.1 time: 0.725831 Feb 20 20:04:19.483191 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 48/88] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:18 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1315 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:19.487658 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a0ac71b0-0427-402b-a2e8-55c666ae929c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:19.488280 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a0ac71b0-0427-402b-a2e8-55c666ae929c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:19.489244 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a0ac71b0-0427-402b-a2e8-55c666ae929c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:19.489589 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8e03fbc2-7174-414c-95ba-992d8d3ac445 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:19.489965 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a0ac71b0-0427-402b-a2e8-55c666ae929c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:19.490189 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8e03fbc2-7174-414c-95ba-992d8d3ac445 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:19.499311 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8e03fbc2-7174-414c-95ba-992d8d3ac445 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:19.500013 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8e03fbc2-7174-414c-95ba-992d8d3ac445 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:19.501040 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8e03fbc2-7174-414c-95ba-992d8d3ac445 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:19.501657 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8e03fbc2-7174-414c-95ba-992d8d3ac445 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:19.661009 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a0ac71b0-0427-402b-a2e8-55c666ae929c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:19.669426 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a0ac71b0-0427-402b-a2e8-55c666ae929c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1288 microversion: 2.1 time: 0.193112 Feb 20 20:04:19.670272 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 41/89] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:19 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1288 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:19.695210 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8e03fbc2-7174-414c-95ba-992d8d3ac445 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:19.699312 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8e03fbc2-7174-414c-95ba-992d8d3ac445 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1279 microversion: 2.1 time: 0.214528 Feb 20 20:04:19.706230 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 49/90] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:19 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1279 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:20.025217 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-2a5d0582-dcbc-43dc-8cc7-ee0f83c6336f req-5fd38f50-81a1-47f8-bf84-52040122c9dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e394c2c-f9ca-4e79-9a43-f6a04f887f71", "tag": "93f93cb7-06aa-4758-87e2-1a0fb13262c4"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:04:20.027916 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:04:20.027916 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:04:20.038437 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-2a5d0582-dcbc-43dc-8cc7-ee0f83c6336f req-5fd38f50-81a1-47f8-bf84-52040122c9dc service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:20.042781 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-2a5d0582-dcbc-43dc-8cc7-ee0f83c6336f req-5fd38f50-81a1-47f8-bf84-52040122c9dc service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:20.058567 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-2a5d0582-dcbc-43dc-8cc7-ee0f83c6336f req-5fd38f50-81a1-47f8-bf84-52040122c9dc service nova] Creating event network-changed:93f93cb7-06aa-4758-87e2-1a0fb13262c4 for instance 6e394c2c-f9ca-4e79-9a43-f6a04f887f71 on hv-cinder-83008 Feb 20 20:04:20.066003 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-2a5d0582-dcbc-43dc-8cc7-ee0f83c6336f req-5fd38f50-81a1-47f8-bf84-52040122c9dc service nova] Acquired lock "compute-rpcapi-router" {{(pid=117087) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 20 20:04:20.066003 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d95d8312-a3e3-4ddc-9ec8-e69fb5b05010 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:20.066003 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d95d8312-a3e3-4ddc-9ec8-e69fb5b05010 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:20.066003 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d95d8312-a3e3-4ddc-9ec8-e69fb5b05010 None None] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:20.066003 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d95d8312-a3e3-4ddc-9ec8-e69fb5b05010 None None] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:20.070675 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.compute.rpcapi [None req-d95d8312-a3e3-4ddc-9ec8-e69fb5b05010 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 20 20:04:20.071544 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d95d8312-a3e3-4ddc-9ec8-e69fb5b05010 None None] Releasing lock "compute-rpcapi-router" {{(pid=117087) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 20 20:04:20.089204 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d95d8312-a3e3-4ddc-9ec8-e69fb5b05010 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125657 Feb 20 20:04:20.089393 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 42/91] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:04:20.480809 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-08e62543-0cb0-4c35-89ae-33782d2eec19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:20.483283 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-08e62543-0cb0-4c35-89ae-33782d2eec19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:20.494727 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-08e62543-0cb0-4c35-89ae-33782d2eec19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:20.495180 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-08e62543-0cb0-4c35-89ae-33782d2eec19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:20.502999 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-08e62543-0cb0-4c35-89ae-33782d2eec19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:20.502999 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-08e62543-0cb0-4c35-89ae-33782d2eec19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:20.503352 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7fa08c49-832f-4320-8682-431cd3536df2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:20.503352 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7fa08c49-832f-4320-8682-431cd3536df2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:20.508999 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7fa08c49-832f-4320-8682-431cd3536df2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:20.509794 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7fa08c49-832f-4320-8682-431cd3536df2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:20.510638 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7fa08c49-832f-4320-8682-431cd3536df2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:20.511183 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7fa08c49-832f-4320-8682-431cd3536df2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:20.836773 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-08e62543-0cb0-4c35-89ae-33782d2eec19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:20.838051 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7fa08c49-832f-4320-8682-431cd3536df2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:20.851380 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7fa08c49-832f-4320-8682-431cd3536df2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1315 microversion: 2.1 time: 0.355782 Feb 20 20:04:20.856365 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-08e62543-0cb0-4c35-89ae-33782d2eec19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:20.858809 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 43/92] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:20 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:20.861276 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-08e62543-0cb0-4c35-89ae-33782d2eec19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:20.862485 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-08e62543-0cb0-4c35-89ae-33782d2eec19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1408 microversion: 2.20 time: 0.385442 Feb 20 20:04:20.873185 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 50/93] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:20 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1408 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:04:20.875900 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-43ce7444-f6fb-41d6-bef9-c7accb1181af tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:20.876674 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-43ce7444-f6fb-41d6-bef9-c7accb1181af tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:20.878156 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-836bab6e-70b0-4441-96b3-02909be8fdd7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:20.878941 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-836bab6e-70b0-4441-96b3-02909be8fdd7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:20.883101 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-43ce7444-f6fb-41d6-bef9-c7accb1181af tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:20.883586 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-43ce7444-f6fb-41d6-bef9-c7accb1181af tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:20.884363 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-43ce7444-f6fb-41d6-bef9-c7accb1181af tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:20.884796 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-43ce7444-f6fb-41d6-bef9-c7accb1181af tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:20.884902 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-836bab6e-70b0-4441-96b3-02909be8fdd7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:20.885355 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-836bab6e-70b0-4441-96b3-02909be8fdd7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:20.886136 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-836bab6e-70b0-4441-96b3-02909be8fdd7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:20.886578 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-836bab6e-70b0-4441-96b3-02909be8fdd7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:20.978924 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-43ce7444-f6fb-41d6-bef9-c7accb1181af tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:20.987238 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-43ce7444-f6fb-41d6-bef9-c7accb1181af tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1288 microversion: 2.1 time: 0.127374 Feb 20 20:04:20.987832 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 44/94] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:20 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1288 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:21.055013 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-836bab6e-70b0-4441-96b3-02909be8fdd7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:21.063237 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-836bab6e-70b0-4441-96b3-02909be8fdd7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1321 microversion: 2.1 time: 0.188529 Feb 20 20:04:21.063931 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 51/95] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:20 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:21.875730 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8e31f48b-1d9b-4353-983b-c9ea96f46e21 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:21.876328 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8e31f48b-1d9b-4353-983b-c9ea96f46e21 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:21.881013 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-69a975ff-e0be-4e84-8a44-a8d09ceefbb0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:21.881713 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-69a975ff-e0be-4e84-8a44-a8d09ceefbb0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:21.883450 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8e31f48b-1d9b-4353-983b-c9ea96f46e21 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:21.883450 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8e31f48b-1d9b-4353-983b-c9ea96f46e21 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:21.883639 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8e31f48b-1d9b-4353-983b-c9ea96f46e21 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:21.884072 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8e31f48b-1d9b-4353-983b-c9ea96f46e21 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:21.903592 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-69a975ff-e0be-4e84-8a44-a8d09ceefbb0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:21.904078 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-69a975ff-e0be-4e84-8a44-a8d09ceefbb0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:21.905211 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-69a975ff-e0be-4e84-8a44-a8d09ceefbb0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:21.905651 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-69a975ff-e0be-4e84-8a44-a8d09ceefbb0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:22.085228 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8e31f48b-1d9b-4353-983b-c9ea96f46e21 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:22.094926 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8e31f48b-1d9b-4353-983b-c9ea96f46e21 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1315 microversion: 2.1 time: 0.223377 Feb 20 20:04:22.100977 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 45/96] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:21 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:22.105485 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4717f1a4-026a-4363-8303-9d5b3772c8c8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:22.106182 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4717f1a4-026a-4363-8303-9d5b3772c8c8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:22.113834 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-69a975ff-e0be-4e84-8a44-a8d09ceefbb0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:22.114043 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4717f1a4-026a-4363-8303-9d5b3772c8c8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:22.114737 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4717f1a4-026a-4363-8303-9d5b3772c8c8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:22.115804 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4717f1a4-026a-4363-8303-9d5b3772c8c8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:22.116452 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4717f1a4-026a-4363-8303-9d5b3772c8c8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:22.124385 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-69a975ff-e0be-4e84-8a44-a8d09ceefbb0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:22.124679 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-69a975ff-e0be-4e84-8a44-a8d09ceefbb0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:22.125913 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-69a975ff-e0be-4e84-8a44-a8d09ceefbb0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1408 microversion: 2.20 time: 0.248751 Feb 20 20:04:22.127189 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 52/97] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:21 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1408 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:04:22.132098 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-afa85b58-b326-4d89-abe2-c9e8c2f8e6e7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:22.133194 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-afa85b58-b326-4d89-abe2-c9e8c2f8e6e7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:22.141822 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-afa85b58-b326-4d89-abe2-c9e8c2f8e6e7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:22.142269 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-afa85b58-b326-4d89-abe2-c9e8c2f8e6e7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:22.143248 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-afa85b58-b326-4d89-abe2-c9e8c2f8e6e7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:22.143829 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-afa85b58-b326-4d89-abe2-c9e8c2f8e6e7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:22.209642 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4717f1a4-026a-4363-8303-9d5b3772c8c8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:22.239972 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4717f1a4-026a-4363-8303-9d5b3772c8c8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1288 microversion: 2.1 time: 0.140523 Feb 20 20:04:22.240548 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 46/98] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:22 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1288 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:22.605435 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-afa85b58-b326-4d89-abe2-c9e8c2f8e6e7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:22.619714 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-afa85b58-b326-4d89-abe2-c9e8c2f8e6e7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1321 microversion: 2.1 time: 0.490755 Feb 20 20:04:22.634553 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 53/99] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:22 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1321 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:23.113994 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e9ad31ae-0945-4459-aa57-a1cd0534f776 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:23.115139 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e9ad31ae-0945-4459-aa57-a1cd0534f776 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:23.126451 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e9ad31ae-0945-4459-aa57-a1cd0534f776 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:23.126903 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e9ad31ae-0945-4459-aa57-a1cd0534f776 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:23.127679 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e9ad31ae-0945-4459-aa57-a1cd0534f776 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:23.128113 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e9ad31ae-0945-4459-aa57-a1cd0534f776 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:23.145534 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-85afd4aa-caf5-4931-bfff-5b1126527d85 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:23.146787 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-85afd4aa-caf5-4931-bfff-5b1126527d85 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:23.158346 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-85afd4aa-caf5-4931-bfff-5b1126527d85 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:23.160231 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-85afd4aa-caf5-4931-bfff-5b1126527d85 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:23.163418 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-85afd4aa-caf5-4931-bfff-5b1126527d85 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:23.165556 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-85afd4aa-caf5-4931-bfff-5b1126527d85 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:23.808606 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e9ad31ae-0945-4459-aa57-a1cd0534f776 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:23.823125 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e9ad31ae-0945-4459-aa57-a1cd0534f776 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1315 microversion: 2.1 time: 0.712754 Feb 20 20:04:23.824422 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 47/100] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:23 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1315 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:23.841849 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-90ae00e7-a4c4-4f48-a3d5-070c128f106a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:23.842837 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-90ae00e7-a4c4-4f48-a3d5-070c128f106a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:23.850798 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-90ae00e7-a4c4-4f48-a3d5-070c128f106a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:23.851482 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-90ae00e7-a4c4-4f48-a3d5-070c128f106a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:23.852863 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-90ae00e7-a4c4-4f48-a3d5-070c128f106a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:23.853483 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-90ae00e7-a4c4-4f48-a3d5-070c128f106a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:23.885427 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-85afd4aa-caf5-4931-bfff-5b1126527d85 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:23.895720 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-85afd4aa-caf5-4931-bfff-5b1126527d85 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:23.897825 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-85afd4aa-caf5-4931-bfff-5b1126527d85 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:23.899128 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-85afd4aa-caf5-4931-bfff-5b1126527d85 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1408 microversion: 2.20 time: 0.757555 Feb 20 20:04:23.910025 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 54/101] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:23 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1408 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:04:23.910025 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-06834875-03b8-4819-8560-b7afbd646f24 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:23.910025 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-06834875-03b8-4819-8560-b7afbd646f24 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:23.913255 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-06834875-03b8-4819-8560-b7afbd646f24 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:23.913804 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-06834875-03b8-4819-8560-b7afbd646f24 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:23.914735 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-06834875-03b8-4819-8560-b7afbd646f24 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:23.915263 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-06834875-03b8-4819-8560-b7afbd646f24 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:24.012408 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-90ae00e7-a4c4-4f48-a3d5-070c128f106a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:24.025170 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-90ae00e7-a4c4-4f48-a3d5-070c128f106a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1294 microversion: 2.1 time: 0.199357 Feb 20 20:04:24.027750 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 48/102] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:23 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1294 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:24.465857 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-06834875-03b8-4819-8560-b7afbd646f24 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:24.499528 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-06834875-03b8-4819-8560-b7afbd646f24 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1321 microversion: 2.1 time: 0.595601 Feb 20 20:04:24.500494 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 55/103] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:23 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1321 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:24.662421 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-3b3d1706-9cd0-4496-88f3-b117b91c8634 req-10a5176b-5fd2-4db5-8a8f-94b77962a411 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52443e14-8400-4a24-8928-b6c1ccd822a5", "tag": "c6f9bc83-3d9c-4fbd-973e-18a908aadda3"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:04:24.670794 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:04:24.670794 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:04:24.688804 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-3b3d1706-9cd0-4496-88f3-b117b91c8634 req-10a5176b-5fd2-4db5-8a8f-94b77962a411 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:24.689490 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-3b3d1706-9cd0-4496-88f3-b117b91c8634 req-10a5176b-5fd2-4db5-8a8f-94b77962a411 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:24.708154 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-3b3d1706-9cd0-4496-88f3-b117b91c8634 req-10a5176b-5fd2-4db5-8a8f-94b77962a411 service nova] Creating event network-changed:c6f9bc83-3d9c-4fbd-973e-18a908aadda3 for instance 52443e14-8400-4a24-8928-b6c1ccd822a5 on hv-cinder-83008 Feb 20 20:04:24.714163 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-3b3d1706-9cd0-4496-88f3-b117b91c8634 req-10a5176b-5fd2-4db5-8a8f-94b77962a411 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062003 Feb 20 20:04:24.715645 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 49/104] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:04:24.845691 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-fed5bce6-babb-4567-8994-08f76fbeb060 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:24.847900 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-fed5bce6-babb-4567-8994-08f76fbeb060 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:24.863658 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fed5bce6-babb-4567-8994-08f76fbeb060 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:24.865554 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fed5bce6-babb-4567-8994-08f76fbeb060 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:24.866783 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fed5bce6-babb-4567-8994-08f76fbeb060 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:24.867398 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fed5bce6-babb-4567-8994-08f76fbeb060 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:24.917365 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-efe383f6-98b3-4ea3-bc31-c3ecd70f74d1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:24.918413 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-efe383f6-98b3-4ea3-bc31-c3ecd70f74d1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:24.934581 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-efe383f6-98b3-4ea3-bc31-c3ecd70f74d1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:24.938975 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-efe383f6-98b3-4ea3-bc31-c3ecd70f74d1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:24.940119 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-efe383f6-98b3-4ea3-bc31-c3ecd70f74d1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:24.940724 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-efe383f6-98b3-4ea3-bc31-c3ecd70f74d1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:25.860291 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-efe383f6-98b3-4ea3-bc31-c3ecd70f74d1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:25.869312 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-efe383f6-98b3-4ea3-bc31-c3ecd70f74d1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:25.874659 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-efe383f6-98b3-4ea3-bc31-c3ecd70f74d1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:25.876395 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-efe383f6-98b3-4ea3-bc31-c3ecd70f74d1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1408 microversion: 2.20 time: 0.962925 Feb 20 20:04:25.877111 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 50/105] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:24 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1408 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:04:25.881313 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-fed5bce6-babb-4567-8994-08f76fbeb060 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:25.886077 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f55f7b08-3284-455c-a687-f75e2330dae3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:25.886994 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f55f7b08-3284-455c-a687-f75e2330dae3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:25.893839 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-fed5bce6-babb-4567-8994-08f76fbeb060 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1315 microversion: 2.1 time: 1.055630 Feb 20 20:04:25.894766 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 56/106] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:24 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1315 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:25.899343 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6f0fcc28-560d-4d5a-b0bb-53f718573055 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:25.907477 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6f0fcc28-560d-4d5a-b0bb-53f718573055 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:25.907477 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6f0fcc28-560d-4d5a-b0bb-53f718573055 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:25.907477 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6f0fcc28-560d-4d5a-b0bb-53f718573055 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:25.908560 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f55f7b08-3284-455c-a687-f75e2330dae3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:25.908707 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6f0fcc28-560d-4d5a-b0bb-53f718573055 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:25.908778 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f55f7b08-3284-455c-a687-f75e2330dae3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:25.908897 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6f0fcc28-560d-4d5a-b0bb-53f718573055 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:25.909190 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f55f7b08-3284-455c-a687-f75e2330dae3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:25.910139 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f55f7b08-3284-455c-a687-f75e2330dae3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:26.149487 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6f0fcc28-560d-4d5a-b0bb-53f718573055 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:26.158145 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6f0fcc28-560d-4d5a-b0bb-53f718573055 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1321 microversion: 2.1 time: 0.262324 Feb 20 20:04:26.159369 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 57/107] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:25 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:26.164411 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f55f7b08-3284-455c-a687-f75e2330dae3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:26.169623 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-0dfc8bb5-796b-4286-8331-4510e600dd0a req-9dfce1fc-2f61-4835-9d58-395e17fce3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6", "tag": "902a9701-9d4c-46bc-961e-7f1df743d7d7"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:04:26.171255 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:04:26.171255 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:04:26.174098 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f55f7b08-3284-455c-a687-f75e2330dae3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1362 microversion: 2.1 time: 0.295774 Feb 20 20:04:26.175034 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 51/108] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:25 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1362 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:26.178478 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-0dfc8bb5-796b-4286-8331-4510e600dd0a req-9dfce1fc-2f61-4835-9d58-395e17fce3e4 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:26.178906 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-0dfc8bb5-796b-4286-8331-4510e600dd0a req-9dfce1fc-2f61-4835-9d58-395e17fce3e4 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:26.191237 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-0dfc8bb5-796b-4286-8331-4510e600dd0a req-9dfce1fc-2f61-4835-9d58-395e17fce3e4 service nova] Creating event network-changed:902a9701-9d4c-46bc-961e-7f1df743d7d7 for instance ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 on hv-cinder-83008 Feb 20 20:04:26.196571 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-0dfc8bb5-796b-4286-8331-4510e600dd0a req-9dfce1fc-2f61-4835-9d58-395e17fce3e4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035895 Feb 20 20:04:26.197186 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 58/109] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:04:26.246578 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-091ec18b-c696-4971-8f67-1d18145d0271 req-52c69c90-9f75-480f-8616-2cd844ccdb39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27be4751-a3cc-4912-8cc9-fb61d611698d", "name": "network-vif-plugged", "status": "completed", "tag": "d256f7e8-1d52-4116-97eb-a03ae94013f4"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:04:26.248890 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:04:26.248890 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:04:26.255806 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-091ec18b-c696-4971-8f67-1d18145d0271 req-52c69c90-9f75-480f-8616-2cd844ccdb39 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:26.256242 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-091ec18b-c696-4971-8f67-1d18145d0271 req-52c69c90-9f75-480f-8616-2cd844ccdb39 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:26.267235 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-091ec18b-c696-4971-8f67-1d18145d0271 req-52c69c90-9f75-480f-8616-2cd844ccdb39 service nova] Creating event network-vif-plugged:d256f7e8-1d52-4116-97eb-a03ae94013f4 for instance 27be4751-a3cc-4912-8cc9-fb61d611698d on hv-cinder-83008 Feb 20 20:04:26.272121 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-091ec18b-c696-4971-8f67-1d18145d0271 req-52c69c90-9f75-480f-8616-2cd844ccdb39 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095885 Feb 20 20:04:26.272713 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 52/110] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:04:26.732186 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-f7957ca3-bae8-4b41-bfbb-33782e2069af req-d193f533-801b-4e71-aba2-23ef8a5d3008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97", "tag": "87a52ebd-35dd-4b56-8924-9578f176542c"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:04:26.733743 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:04:26.733743 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:04:26.740944 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-f7957ca3-bae8-4b41-bfbb-33782e2069af req-d193f533-801b-4e71-aba2-23ef8a5d3008 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:26.741423 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-f7957ca3-bae8-4b41-bfbb-33782e2069af req-d193f533-801b-4e71-aba2-23ef8a5d3008 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:26.753039 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-f7957ca3-bae8-4b41-bfbb-33782e2069af req-d193f533-801b-4e71-aba2-23ef8a5d3008 service nova] Creating event network-changed:87a52ebd-35dd-4b56-8924-9578f176542c for instance d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 on hv-cinder-83008 Feb 20 20:04:26.758084 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-f7957ca3-bae8-4b41-bfbb-33782e2069af req-d193f533-801b-4e71-aba2-23ef8a5d3008 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029867 Feb 20 20:04:26.759027 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 59/111] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:04:26.898140 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5328a6d8-3418-4b37-aa77-34ff2314bdf5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:26.903355 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5328a6d8-3418-4b37-aa77-34ff2314bdf5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:26.910515 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5328a6d8-3418-4b37-aa77-34ff2314bdf5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:26.910972 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5328a6d8-3418-4b37-aa77-34ff2314bdf5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:26.911337 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7f0c3884-2983-40b3-ba33-b4bc461a14ce tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:26.911803 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5328a6d8-3418-4b37-aa77-34ff2314bdf5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:26.912034 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7f0c3884-2983-40b3-ba33-b4bc461a14ce tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:26.913021 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5328a6d8-3418-4b37-aa77-34ff2314bdf5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:26.920473 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7f0c3884-2983-40b3-ba33-b4bc461a14ce tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:26.921144 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7f0c3884-2983-40b3-ba33-b4bc461a14ce tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:26.921936 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7f0c3884-2983-40b3-ba33-b4bc461a14ce tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:26.922370 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7f0c3884-2983-40b3-ba33-b4bc461a14ce tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:27.318304 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5328a6d8-3418-4b37-aa77-34ff2314bdf5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:27.321484 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7f0c3884-2983-40b3-ba33-b4bc461a14ce tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:27.327282 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5328a6d8-3418-4b37-aa77-34ff2314bdf5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:27.328895 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5328a6d8-3418-4b37-aa77-34ff2314bdf5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:27.329997 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7f0c3884-2983-40b3-ba33-b4bc461a14ce tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1315 microversion: 2.1 time: 0.422707 Feb 20 20:04:27.330144 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5328a6d8-3418-4b37-aa77-34ff2314bdf5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1408 microversion: 2.20 time: 0.438449 Feb 20 20:04:27.330711 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 53/112] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:26 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1408 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:04:27.331335 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 60/113] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:26 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:04:27.340616 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-feceaabc-a3f2-4cb7-81e5-48c8a0747c4b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:27.345133 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-597631de-8a93-45e3-acb9-fbc68ff34e8a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:27.345839 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-597631de-8a93-45e3-acb9-fbc68ff34e8a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:27.345958 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-feceaabc-a3f2-4cb7-81e5-48c8a0747c4b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:27.351908 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-597631de-8a93-45e3-acb9-fbc68ff34e8a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:27.352037 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-feceaabc-a3f2-4cb7-81e5-48c8a0747c4b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:27.352398 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-feceaabc-a3f2-4cb7-81e5-48c8a0747c4b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:27.352506 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-597631de-8a93-45e3-acb9-fbc68ff34e8a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:27.353341 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-597631de-8a93-45e3-acb9-fbc68ff34e8a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:27.353452 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-feceaabc-a3f2-4cb7-81e5-48c8a0747c4b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:27.353832 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-feceaabc-a3f2-4cb7-81e5-48c8a0747c4b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:27.353930 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-597631de-8a93-45e3-acb9-fbc68ff34e8a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:27.640352 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-feceaabc-a3f2-4cb7-81e5-48c8a0747c4b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:27.647928 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-feceaabc-a3f2-4cb7-81e5-48c8a0747c4b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1321 microversion: 2.1 time: 0.311218 Feb 20 20:04:27.655592 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-597631de-8a93-45e3-acb9-fbc68ff34e8a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:27.657781 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 54/114] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:27 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1321 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:27.663116 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-597631de-8a93-45e3-acb9-fbc68ff34e8a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1362 microversion: 2.1 time: 0.330623 Feb 20 20:04:27.663674 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 61/115] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:27 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1362 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:28.351354 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4c6148aa-a9c2-4067-a2a8-ac02c6ab6858 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:28.352117 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0c390d74-8cdc-40ae-aff7-ec073374a77a tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:28.352848 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-0c390d74-8cdc-40ae-aff7-ec073374a77a tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:28.357413 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4c6148aa-a9c2-4067-a2a8-ac02c6ab6858 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:28.371966 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0c390d74-8cdc-40ae-aff7-ec073374a77a tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:28.373768 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0c390d74-8cdc-40ae-aff7-ec073374a77a tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:28.374829 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0c390d74-8cdc-40ae-aff7-ec073374a77a tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:28.375960 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4c6148aa-a9c2-4067-a2a8-ac02c6ab6858 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:28.376575 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0c390d74-8cdc-40ae-aff7-ec073374a77a tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:28.377400 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4c6148aa-a9c2-4067-a2a8-ac02c6ab6858 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:28.379875 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4c6148aa-a9c2-4067-a2a8-ac02c6ab6858 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:28.381749 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4c6148aa-a9c2-4067-a2a8-ac02c6ab6858 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:29.030915 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4c6148aa-a9c2-4067-a2a8-ac02c6ab6858 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:29.050465 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4c6148aa-a9c2-4067-a2a8-ac02c6ab6858 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:29.053527 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4c6148aa-a9c2-4067-a2a8-ac02c6ab6858 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:29.054676 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4c6148aa-a9c2-4067-a2a8-ac02c6ab6858 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1408 microversion: 2.20 time: 0.709707 Feb 20 20:04:29.055625 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 55/116] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:28 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1408 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:04:29.060487 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6beba1b7-7b46-4df1-bebb-1f2f7a3b8b88 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:29.061170 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6beba1b7-7b46-4df1-bebb-1f2f7a3b8b88 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:29.067247 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0c390d74-8cdc-40ae-aff7-ec073374a77a tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:29.070946 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6beba1b7-7b46-4df1-bebb-1f2f7a3b8b88 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:29.070946 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6beba1b7-7b46-4df1-bebb-1f2f7a3b8b88 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:29.070946 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6beba1b7-7b46-4df1-bebb-1f2f7a3b8b88 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:29.070946 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6beba1b7-7b46-4df1-bebb-1f2f7a3b8b88 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:29.078655 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-0c390d74-8cdc-40ae-aff7-ec073374a77a tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1315 microversion: 2.1 time: 0.731430 Feb 20 20:04:29.079564 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 62/117] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:28 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1315 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:04:29.090229 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b3258469-321c-42ca-8d71-16c2802ca4f8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:29.091728 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b3258469-321c-42ca-8d71-16c2802ca4f8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:29.105397 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b3258469-321c-42ca-8d71-16c2802ca4f8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:29.105840 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b3258469-321c-42ca-8d71-16c2802ca4f8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:29.108866 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b3258469-321c-42ca-8d71-16c2802ca4f8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:29.110083 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b3258469-321c-42ca-8d71-16c2802ca4f8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:29.497969 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6beba1b7-7b46-4df1-bebb-1f2f7a3b8b88 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:29.501593 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b3258469-321c-42ca-8d71-16c2802ca4f8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:29.508318 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6beba1b7-7b46-4df1-bebb-1f2f7a3b8b88 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1321 microversion: 2.1 time: 0.451448 Feb 20 20:04:29.515046 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b3258469-321c-42ca-8d71-16c2802ca4f8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1362 microversion: 2.1 time: 0.431914 Feb 20 20:04:29.516055 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 63/118] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:29 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1362 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:29.518976 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 56/119] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:29 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1321 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:30.072455 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-47f1007f-8427-44ef-81a6-b1b430eeafce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:30.072992 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-47f1007f-8427-44ef-81a6-b1b430eeafce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:30.081290 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-47f1007f-8427-44ef-81a6-b1b430eeafce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:30.087351 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-47f1007f-8427-44ef-81a6-b1b430eeafce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:30.087351 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-47f1007f-8427-44ef-81a6-b1b430eeafce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:30.087351 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-47f1007f-8427-44ef-81a6-b1b430eeafce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:30.096438 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9db6d5f2-0799-44ae-b0b0-2fdb960cded5 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:30.097055 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9db6d5f2-0799-44ae-b0b0-2fdb960cded5 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:30.107348 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9db6d5f2-0799-44ae-b0b0-2fdb960cded5 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:30.107809 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9db6d5f2-0799-44ae-b0b0-2fdb960cded5 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:30.110262 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9db6d5f2-0799-44ae-b0b0-2fdb960cded5 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:30.112137 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9db6d5f2-0799-44ae-b0b0-2fdb960cded5 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:30.417679 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-47f1007f-8427-44ef-81a6-b1b430eeafce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:30.426767 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-47f1007f-8427-44ef-81a6-b1b430eeafce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:30.428329 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-47f1007f-8427-44ef-81a6-b1b430eeafce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:30.429840 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-47f1007f-8427-44ef-81a6-b1b430eeafce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1408 microversion: 2.20 time: 0.361059 Feb 20 20:04:30.430900 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 64/120] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:30 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1408 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:04:30.467887 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-9db6d5f2-0799-44ae-b0b0-2fdb960cded5 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:30.475760 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9db6d5f2-0799-44ae-b0b0-2fdb960cded5 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1315 microversion: 2.1 time: 0.384031 Feb 20 20:04:30.480776 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 57/121] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:30 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:04:30.526334 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5e12e34c-380c-49df-a42d-ae44f69ed1a4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:30.527130 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5e12e34c-380c-49df-a42d-ae44f69ed1a4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:30.532363 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-099f70b6-2640-44f7-b704-db28a5245b7b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:30.532958 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-099f70b6-2640-44f7-b704-db28a5245b7b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:30.534978 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5e12e34c-380c-49df-a42d-ae44f69ed1a4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:30.535505 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5e12e34c-380c-49df-a42d-ae44f69ed1a4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:30.536353 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5e12e34c-380c-49df-a42d-ae44f69ed1a4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:30.536943 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5e12e34c-380c-49df-a42d-ae44f69ed1a4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:30.539782 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-099f70b6-2640-44f7-b704-db28a5245b7b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:30.540406 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-099f70b6-2640-44f7-b704-db28a5245b7b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:30.541360 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-099f70b6-2640-44f7-b704-db28a5245b7b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:30.542032 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-099f70b6-2640-44f7-b704-db28a5245b7b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:30.881174 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5e12e34c-380c-49df-a42d-ae44f69ed1a4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:30.883678 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-099f70b6-2640-44f7-b704-db28a5245b7b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:30.890063 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5e12e34c-380c-49df-a42d-ae44f69ed1a4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1321 microversion: 2.1 time: 0.367582 Feb 20 20:04:30.899210 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-099f70b6-2640-44f7-b704-db28a5245b7b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1362 microversion: 2.1 time: 0.371054 Feb 20 20:04:30.900853 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 65/122] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:30 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:30.911801 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 58/123] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:30 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:31.449267 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c4615c84-449b-43d8-b684-c613971b3554 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:31.450032 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c4615c84-449b-43d8-b684-c613971b3554 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:31.464340 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c4615c84-449b-43d8-b684-c613971b3554 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:31.464340 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c4615c84-449b-43d8-b684-c613971b3554 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:31.464670 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c4615c84-449b-43d8-b684-c613971b3554 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:31.465374 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c4615c84-449b-43d8-b684-c613971b3554 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:31.493985 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c144cb0d-6d7a-455d-be8a-5e7fd68fe187 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:31.499081 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c144cb0d-6d7a-455d-be8a-5e7fd68fe187 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:31.503174 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c144cb0d-6d7a-455d-be8a-5e7fd68fe187 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:31.503643 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c144cb0d-6d7a-455d-be8a-5e7fd68fe187 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:31.504589 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c144cb0d-6d7a-455d-be8a-5e7fd68fe187 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:31.505062 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c144cb0d-6d7a-455d-be8a-5e7fd68fe187 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:31.652302 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c4615c84-449b-43d8-b684-c613971b3554 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:31.673215 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c4615c84-449b-43d8-b684-c613971b3554 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:31.675113 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c4615c84-449b-43d8-b684-c613971b3554 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:31.676395 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c4615c84-449b-43d8-b684-c613971b3554 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1408 microversion: 2.20 time: 0.230989 Feb 20 20:04:31.676968 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 66/124] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:31 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:04:31.690076 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-4cec9d27-53c5-4f3a-b43f-d91dbcb0f3e8 req-e6d2191b-1229-4329-bbb9-551a1e538ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e394c2c-f9ca-4e79-9a43-f6a04f887f71", "name": "network-vif-plugged", "status": "completed", "tag": "93f93cb7-06aa-4758-87e2-1a0fb13262c4"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:04:31.691837 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:04:31.691837 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:04:31.699430 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-4cec9d27-53c5-4f3a-b43f-d91dbcb0f3e8 req-e6d2191b-1229-4329-bbb9-551a1e538ba3 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:31.699871 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-4cec9d27-53c5-4f3a-b43f-d91dbcb0f3e8 req-e6d2191b-1229-4329-bbb9-551a1e538ba3 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:31.712598 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-4cec9d27-53c5-4f3a-b43f-d91dbcb0f3e8 req-e6d2191b-1229-4329-bbb9-551a1e538ba3 service nova] Creating event network-vif-plugged:93f93cb7-06aa-4758-87e2-1a0fb13262c4 for instance 6e394c2c-f9ca-4e79-9a43-f6a04f887f71 on hv-cinder-83008 Feb 20 20:04:31.722506 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-4cec9d27-53c5-4f3a-b43f-d91dbcb0f3e8 req-e6d2191b-1229-4329-bbb9-551a1e538ba3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043634 Feb 20 20:04:31.723581 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 67/125] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:04:31.731656 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c144cb0d-6d7a-455d-be8a-5e7fd68fe187 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:31.738886 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c144cb0d-6d7a-455d-be8a-5e7fd68fe187 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1315 microversion: 2.1 time: 0.249211 Feb 20 20:04:31.739445 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 59/126] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:31 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:04:31.909906 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f1385b0c-69d4-4d3d-819c-9200908484d7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:31.911162 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f1385b0c-69d4-4d3d-819c-9200908484d7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:31.916727 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f1385b0c-69d4-4d3d-819c-9200908484d7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:31.917423 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f1385b0c-69d4-4d3d-819c-9200908484d7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:31.918211 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f1385b0c-69d4-4d3d-819c-9200908484d7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:31.918636 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f1385b0c-69d4-4d3d-819c-9200908484d7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:31.931527 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-caf61b9c-7b29-4501-847e-e78b3f0544ca tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:31.932132 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-caf61b9c-7b29-4501-847e-e78b3f0544ca tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:31.940863 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-caf61b9c-7b29-4501-847e-e78b3f0544ca tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:31.941507 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-caf61b9c-7b29-4501-847e-e78b3f0544ca tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:31.942489 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-caf61b9c-7b29-4501-847e-e78b3f0544ca tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:31.943087 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-caf61b9c-7b29-4501-847e-e78b3f0544ca tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:32.135139 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f1385b0c-69d4-4d3d-819c-9200908484d7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:32.142930 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f1385b0c-69d4-4d3d-819c-9200908484d7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1321 microversion: 2.1 time: 0.238184 Feb 20 20:04:32.146173 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 68/127] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:31 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:32.167654 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-caf61b9c-7b29-4501-847e-e78b3f0544ca tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:32.177978 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-caf61b9c-7b29-4501-847e-e78b3f0544ca tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1362 microversion: 2.1 time: 0.249873 Feb 20 20:04:32.179136 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 60/128] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:31 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:32.694276 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-25fdc20c-919c-48a3-91e4-3900b1e0a87f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:32.694886 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-25fdc20c-919c-48a3-91e4-3900b1e0a87f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:32.702429 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-25fdc20c-919c-48a3-91e4-3900b1e0a87f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:32.703134 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-25fdc20c-919c-48a3-91e4-3900b1e0a87f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:32.704139 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-25fdc20c-919c-48a3-91e4-3900b1e0a87f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:32.704811 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-25fdc20c-919c-48a3-91e4-3900b1e0a87f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:32.755547 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-81eaabc5-f8d7-4c5b-96cf-e22194bb50f3 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:32.756165 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-81eaabc5-f8d7-4c5b-96cf-e22194bb50f3 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:32.766472 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-81eaabc5-f8d7-4c5b-96cf-e22194bb50f3 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:32.767914 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-81eaabc5-f8d7-4c5b-96cf-e22194bb50f3 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:32.769053 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-81eaabc5-f8d7-4c5b-96cf-e22194bb50f3 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:32.769678 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-81eaabc5-f8d7-4c5b-96cf-e22194bb50f3 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:32.891210 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-25fdc20c-919c-48a3-91e4-3900b1e0a87f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:32.899268 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-25fdc20c-919c-48a3-91e4-3900b1e0a87f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:32.900763 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-25fdc20c-919c-48a3-91e4-3900b1e0a87f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:32.902230 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-25fdc20c-919c-48a3-91e4-3900b1e0a87f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1408 microversion: 2.20 time: 0.211604 Feb 20 20:04:32.902965 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 69/129] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:32 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:04:32.957381 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-81eaabc5-f8d7-4c5b-96cf-e22194bb50f3 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:32.964583 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-81eaabc5-f8d7-4c5b-96cf-e22194bb50f3 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1501 microversion: 2.1 time: 0.212637 Feb 20 20:04:32.965449 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 61/130] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:32 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1501 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:04:33.160074 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-139a3478-409b-43ac-83ac-fcf7c6d06e10 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:33.160684 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-139a3478-409b-43ac-83ac-fcf7c6d06e10 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:33.167040 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-139a3478-409b-43ac-83ac-fcf7c6d06e10 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:33.167040 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-139a3478-409b-43ac-83ac-fcf7c6d06e10 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:33.167744 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-139a3478-409b-43ac-83ac-fcf7c6d06e10 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:33.168515 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-139a3478-409b-43ac-83ac-fcf7c6d06e10 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:33.195427 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-0fbe0313-3fa5-41c1-a2b1-3150a7bfec45 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:33.196039 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-0fbe0313-3fa5-41c1-a2b1-3150a7bfec45 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:33.206380 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0fbe0313-3fa5-41c1-a2b1-3150a7bfec45 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:33.207775 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0fbe0313-3fa5-41c1-a2b1-3150a7bfec45 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:33.208704 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0fbe0313-3fa5-41c1-a2b1-3150a7bfec45 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:33.209373 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0fbe0313-3fa5-41c1-a2b1-3150a7bfec45 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:33.355716 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-139a3478-409b-43ac-83ac-fcf7c6d06e10 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:33.363744 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-139a3478-409b-43ac-83ac-fcf7c6d06e10 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1321 microversion: 2.1 time: 0.207267 Feb 20 20:04:33.364327 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 70/131] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:33 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:33.416695 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0fbe0313-3fa5-41c1-a2b1-3150a7bfec45 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:33.422144 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-0fbe0313-3fa5-41c1-a2b1-3150a7bfec45 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1362 microversion: 2.1 time: 0.230151 Feb 20 20:04:33.431259 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 62/132] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:33 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:04:33.924087 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6e9d2092-4528-4bce-aa5d-7fd4fada9836 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:33.924689 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6e9d2092-4528-4bce-aa5d-7fd4fada9836 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:33.930889 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6e9d2092-4528-4bce-aa5d-7fd4fada9836 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:33.931411 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6e9d2092-4528-4bce-aa5d-7fd4fada9836 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:33.932210 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6e9d2092-4528-4bce-aa5d-7fd4fada9836 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:33.932638 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6e9d2092-4528-4bce-aa5d-7fd4fada9836 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:34.077221 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6e9d2092-4528-4bce-aa5d-7fd4fada9836 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:34.085172 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6e9d2092-4528-4bce-aa5d-7fd4fada9836 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:34.086665 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6e9d2092-4528-4bce-aa5d-7fd4fada9836 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:34.087760 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6e9d2092-4528-4bce-aa5d-7fd4fada9836 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1408 microversion: 2.20 time: 0.169124 Feb 20 20:04:34.088318 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 71/133] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:33 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:04:34.381313 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-bc82ff2a-3c36-4e70-b40b-fc52268807a6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:34.381944 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-bc82ff2a-3c36-4e70-b40b-fc52268807a6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:34.387688 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bc82ff2a-3c36-4e70-b40b-fc52268807a6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:34.388127 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bc82ff2a-3c36-4e70-b40b-fc52268807a6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:34.388893 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bc82ff2a-3c36-4e70-b40b-fc52268807a6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:34.389350 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bc82ff2a-3c36-4e70-b40b-fc52268807a6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:34.438660 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-acd04fab-901d-47b3-ae93-d37b3041347c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:34.439278 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-acd04fab-901d-47b3-ae93-d37b3041347c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:34.445364 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-acd04fab-901d-47b3-ae93-d37b3041347c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:34.445889 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-acd04fab-901d-47b3-ae93-d37b3041347c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:34.446771 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-acd04fab-901d-47b3-ae93-d37b3041347c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:34.447281 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-acd04fab-901d-47b3-ae93-d37b3041347c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:34.563934 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-bc82ff2a-3c36-4e70-b40b-fc52268807a6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:34.573006 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-bc82ff2a-3c36-4e70-b40b-fc52268807a6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1321 microversion: 2.1 time: 0.195327 Feb 20 20:04:34.573746 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 63/134] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:34 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:34.630271 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-acd04fab-901d-47b3-ae93-d37b3041347c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:34.637491 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-acd04fab-901d-47b3-ae93-d37b3041347c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1362 microversion: 2.1 time: 0.202720 Feb 20 20:04:34.638066 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 72/135] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:34 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:04:35.106627 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-0dde167f-9303-4d85-8818-123a945ddfd9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:35.107237 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-0dde167f-9303-4d85-8818-123a945ddfd9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:35.113782 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0dde167f-9303-4d85-8818-123a945ddfd9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:35.114237 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0dde167f-9303-4d85-8818-123a945ddfd9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:35.115067 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0dde167f-9303-4d85-8818-123a945ddfd9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:35.115503 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0dde167f-9303-4d85-8818-123a945ddfd9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:35.253572 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0dde167f-9303-4d85-8818-123a945ddfd9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:35.265565 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0dde167f-9303-4d85-8818-123a945ddfd9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:35.265565 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0dde167f-9303-4d85-8818-123a945ddfd9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:35.265565 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-0dde167f-9303-4d85-8818-123a945ddfd9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1408 microversion: 2.20 time: 0.161838 Feb 20 20:04:35.266786 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 64/136] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:35 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:04:35.590802 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-550ddbc6-b907-4c29-9719-0e9509528948 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:35.591421 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-550ddbc6-b907-4c29-9719-0e9509528948 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:35.597972 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-550ddbc6-b907-4c29-9719-0e9509528948 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:35.598691 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-550ddbc6-b907-4c29-9719-0e9509528948 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:35.599480 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-550ddbc6-b907-4c29-9719-0e9509528948 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:35.599919 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-550ddbc6-b907-4c29-9719-0e9509528948 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:35.663680 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-61546fe4-7868-4ef8-88a7-eb9e20baa117 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:35.664567 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-61546fe4-7868-4ef8-88a7-eb9e20baa117 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:35.672083 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-61546fe4-7868-4ef8-88a7-eb9e20baa117 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:35.672602 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-61546fe4-7868-4ef8-88a7-eb9e20baa117 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:35.673409 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-61546fe4-7868-4ef8-88a7-eb9e20baa117 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:35.673995 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-61546fe4-7868-4ef8-88a7-eb9e20baa117 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:35.793450 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-550ddbc6-b907-4c29-9719-0e9509528948 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:35.802046 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-550ddbc6-b907-4c29-9719-0e9509528948 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1321 microversion: 2.1 time: 0.215360 Feb 20 20:04:35.802627 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 73/137] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:35 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:35.867609 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b1322513-fa96-4617-a2b8-624e34236143 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0afe3335-00e6-4837-8841-1495939531d5"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:04:35.869412 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b1322513-fa96-4617-a2b8-624e34236143 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:35.870714 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-61546fe4-7868-4ef8-88a7-eb9e20baa117 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:35.881164 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-61546fe4-7868-4ef8-88a7-eb9e20baa117 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1362 microversion: 2.1 time: 0.229670 Feb 20 20:04:35.885305 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 65/138] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:35 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:35.891723 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b1322513-fa96-4617-a2b8-624e34236143 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:35.892320 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b1322513-fa96-4617-a2b8-624e34236143 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:35.893291 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b1322513-fa96-4617-a2b8-624e34236143 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:35.893729 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b1322513-fa96-4617-a2b8-624e34236143 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:36.284847 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d3491fd7-d322-4dc1-847a-0d9df5ddc352 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:36.285465 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d3491fd7-d322-4dc1-847a-0d9df5ddc352 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:36.291445 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d3491fd7-d322-4dc1-847a-0d9df5ddc352 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:36.291888 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d3491fd7-d322-4dc1-847a-0d9df5ddc352 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:36.292839 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d3491fd7-d322-4dc1-847a-0d9df5ddc352 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:36.293304 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d3491fd7-d322-4dc1-847a-0d9df5ddc352 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:36.434716 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d3491fd7-d322-4dc1-847a-0d9df5ddc352 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:36.443669 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d3491fd7-d322-4dc1-847a-0d9df5ddc352 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:36.446685 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d3491fd7-d322-4dc1-847a-0d9df5ddc352 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:36.447776 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d3491fd7-d322-4dc1-847a-0d9df5ddc352 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1408 microversion: 2.20 time: 0.167677 Feb 20 20:04:36.449073 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 66/139] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:36 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:04:36.797003 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b1322513-fa96-4617-a2b8-624e34236143 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "POST /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.932244 Feb 20 20:04:36.799719 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 74/140] 10.222.0.60 () {60 vars in 1322 bytes} [Sun Feb 20 20:04:35 2022] POST /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d/os-volume_attachments => generated 194 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:04:36.818984 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-38cc6122-75e8-41ee-9117-2c407de301bf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:36.819597 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-38cc6122-75e8-41ee-9117-2c407de301bf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:36.825420 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-38cc6122-75e8-41ee-9117-2c407de301bf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:36.825879 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-38cc6122-75e8-41ee-9117-2c407de301bf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:36.826659 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-38cc6122-75e8-41ee-9117-2c407de301bf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:36.827710 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-38cc6122-75e8-41ee-9117-2c407de301bf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:36.926289 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a9ca81bb-3682-455d-b97e-df248446ccf0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:36.926289 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a9ca81bb-3682-455d-b97e-df248446ccf0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:36.926289 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a9ca81bb-3682-455d-b97e-df248446ccf0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:36.926289 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a9ca81bb-3682-455d-b97e-df248446ccf0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:36.927587 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a9ca81bb-3682-455d-b97e-df248446ccf0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:36.927587 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a9ca81bb-3682-455d-b97e-df248446ccf0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:37.010047 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-38cc6122-75e8-41ee-9117-2c407de301bf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:37.017745 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-38cc6122-75e8-41ee-9117-2c407de301bf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1321 microversion: 2.1 time: 0.202365 Feb 20 20:04:37.018337 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 67/141] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:36 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:37.079934 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a9ca81bb-3682-455d-b97e-df248446ccf0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:37.087811 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a9ca81bb-3682-455d-b97e-df248446ccf0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1362 microversion: 2.1 time: 0.191319 Feb 20 20:04:37.088391 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 75/142] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:36 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:04:37.443955 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-1cd888a4-297b-495a-898c-d3a809caaf25 req-650dc6e5-55b0-4c6f-9487-318566cba17b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97", "name": "network-vif-plugged", "status": "completed", "tag": "87a52ebd-35dd-4b56-8924-9578f176542c"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:04:37.445867 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:04:37.445867 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:04:37.453134 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-1cd888a4-297b-495a-898c-d3a809caaf25 req-650dc6e5-55b0-4c6f-9487-318566cba17b service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:37.453590 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-1cd888a4-297b-495a-898c-d3a809caaf25 req-650dc6e5-55b0-4c6f-9487-318566cba17b service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:37.465162 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-1cd888a4-297b-495a-898c-d3a809caaf25 req-650dc6e5-55b0-4c6f-9487-318566cba17b service nova] Creating event network-vif-plugged:87a52ebd-35dd-4b56-8924-9578f176542c for instance d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 on hv-cinder-83008 Feb 20 20:04:37.466632 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6a70ed2c-3844-453f-923d-cfcfbbb57adc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:37.467377 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6a70ed2c-3844-453f-923d-cfcfbbb57adc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:37.471022 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-1cd888a4-297b-495a-898c-d3a809caaf25 req-650dc6e5-55b0-4c6f-9487-318566cba17b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030507 Feb 20 20:04:37.472003 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 68/143] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:04:37.475790 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6a70ed2c-3844-453f-923d-cfcfbbb57adc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:37.476269 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6a70ed2c-3844-453f-923d-cfcfbbb57adc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:37.477050 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6a70ed2c-3844-453f-923d-cfcfbbb57adc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:37.477545 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6a70ed2c-3844-453f-923d-cfcfbbb57adc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:37.624345 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6a70ed2c-3844-453f-923d-cfcfbbb57adc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:37.632162 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6a70ed2c-3844-453f-923d-cfcfbbb57adc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:37.633698 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6a70ed2c-3844-453f-923d-cfcfbbb57adc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:37.634942 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6a70ed2c-3844-453f-923d-cfcfbbb57adc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1408 microversion: 2.20 time: 0.172143 Feb 20 20:04:37.635650 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 76/144] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:37 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:04:38.035153 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8ea607c1-6b16-4686-a702-ddb4f3819fa1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:38.035855 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8ea607c1-6b16-4686-a702-ddb4f3819fa1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:38.041937 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8ea607c1-6b16-4686-a702-ddb4f3819fa1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:38.042387 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8ea607c1-6b16-4686-a702-ddb4f3819fa1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:38.043157 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8ea607c1-6b16-4686-a702-ddb4f3819fa1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:38.043588 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8ea607c1-6b16-4686-a702-ddb4f3819fa1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:38.105326 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6990bda6-3b66-4fd2-927f-7566028f4f9b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:38.106672 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6990bda6-3b66-4fd2-927f-7566028f4f9b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:38.113180 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6990bda6-3b66-4fd2-927f-7566028f4f9b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:38.113898 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6990bda6-3b66-4fd2-927f-7566028f4f9b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:38.114733 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6990bda6-3b66-4fd2-927f-7566028f4f9b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:38.115243 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6990bda6-3b66-4fd2-927f-7566028f4f9b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:38.214476 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8ea607c1-6b16-4686-a702-ddb4f3819fa1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:38.222854 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8ea607c1-6b16-4686-a702-ddb4f3819fa1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1321 microversion: 2.1 time: 0.192460 Feb 20 20:04:38.223481 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 69/145] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:38 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:38.276287 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6990bda6-3b66-4fd2-927f-7566028f4f9b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:38.283891 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6990bda6-3b66-4fd2-927f-7566028f4f9b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1362 microversion: 2.1 time: 0.182198 Feb 20 20:04:38.284463 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 77/146] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:38 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:04:38.652114 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f0f57fe4-10d7-47c6-afca-49423b61ce2f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:38.652712 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f0f57fe4-10d7-47c6-afca-49423b61ce2f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:38.659227 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f0f57fe4-10d7-47c6-afca-49423b61ce2f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:38.659663 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f0f57fe4-10d7-47c6-afca-49423b61ce2f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:38.660478 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f0f57fe4-10d7-47c6-afca-49423b61ce2f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:38.660932 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f0f57fe4-10d7-47c6-afca-49423b61ce2f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:38.818972 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f0f57fe4-10d7-47c6-afca-49423b61ce2f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:38.834240 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f0f57fe4-10d7-47c6-afca-49423b61ce2f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:38.834240 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f0f57fe4-10d7-47c6-afca-49423b61ce2f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:38.834240 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f0f57fe4-10d7-47c6-afca-49423b61ce2f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1408 microversion: 2.20 time: 0.181731 Feb 20 20:04:38.834564 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 70/147] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:38 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:04:39.240097 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4974fdef-6e14-4fbe-83c2-1bcddf685689 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:39.240706 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4974fdef-6e14-4fbe-83c2-1bcddf685689 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:39.252104 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4974fdef-6e14-4fbe-83c2-1bcddf685689 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:39.256799 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4974fdef-6e14-4fbe-83c2-1bcddf685689 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:39.256799 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4974fdef-6e14-4fbe-83c2-1bcddf685689 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:39.256799 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4974fdef-6e14-4fbe-83c2-1bcddf685689 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:39.300663 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d5d5b155-4df0-4f9c-9716-6e622ad7c515 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:39.304310 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d5d5b155-4df0-4f9c-9716-6e622ad7c515 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:39.307484 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d5d5b155-4df0-4f9c-9716-6e622ad7c515 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:39.307929 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d5d5b155-4df0-4f9c-9716-6e622ad7c515 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:39.308703 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d5d5b155-4df0-4f9c-9716-6e622ad7c515 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:39.309150 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d5d5b155-4df0-4f9c-9716-6e622ad7c515 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:39.427752 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4974fdef-6e14-4fbe-83c2-1bcddf685689 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:39.440212 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4974fdef-6e14-4fbe-83c2-1bcddf685689 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1321 microversion: 2.1 time: 0.203817 Feb 20 20:04:39.441236 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 78/148] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:39 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:39.493328 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d5d5b155-4df0-4f9c-9716-6e622ad7c515 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:39.501300 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d5d5b155-4df0-4f9c-9716-6e622ad7c515 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1362 microversion: 2.1 time: 0.204230 Feb 20 20:04:39.501872 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 71/149] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:39 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:04:39.851495 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8be85b11-0c7d-47a9-b53e-c4c188685d70 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:39.852491 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8be85b11-0c7d-47a9-b53e-c4c188685d70 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:39.863141 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8be85b11-0c7d-47a9-b53e-c4c188685d70 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:39.863960 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8be85b11-0c7d-47a9-b53e-c4c188685d70 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:39.865031 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8be85b11-0c7d-47a9-b53e-c4c188685d70 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:39.865497 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8be85b11-0c7d-47a9-b53e-c4c188685d70 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:39.998542 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8be85b11-0c7d-47a9-b53e-c4c188685d70 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:40.007102 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8be85b11-0c7d-47a9-b53e-c4c188685d70 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:40.008634 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8be85b11-0c7d-47a9-b53e-c4c188685d70 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:40.009807 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8be85b11-0c7d-47a9-b53e-c4c188685d70 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1408 microversion: 2.20 time: 0.161997 Feb 20 20:04:40.010378 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 79/150] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:39 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:04:40.341298 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-bec9c43a-bc39-45f2-b854-0342e0d36854 req-7d234913-ba07-41aa-9e63-c3fa8b1b749d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52443e14-8400-4a24-8928-b6c1ccd822a5", "name": "network-vif-plugged", "status": "completed", "tag": "c6f9bc83-3d9c-4fbd-973e-18a908aadda3"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:04:40.344114 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:04:40.344114 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:04:40.350986 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-bec9c43a-bc39-45f2-b854-0342e0d36854 req-7d234913-ba07-41aa-9e63-c3fa8b1b749d service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:40.351420 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-bec9c43a-bc39-45f2-b854-0342e0d36854 req-7d234913-ba07-41aa-9e63-c3fa8b1b749d service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:40.364280 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-bec9c43a-bc39-45f2-b854-0342e0d36854 req-7d234913-ba07-41aa-9e63-c3fa8b1b749d service nova] Creating event network-vif-plugged:c6f9bc83-3d9c-4fbd-973e-18a908aadda3 for instance 52443e14-8400-4a24-8928-b6c1ccd822a5 on hv-cinder-83008 Feb 20 20:04:40.367971 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-bec9c43a-bc39-45f2-b854-0342e0d36854 req-7d234913-ba07-41aa-9e63-c3fa8b1b749d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030584 Feb 20 20:04:40.368566 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 72/151] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:04:40.460642 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-073692e4-df14-44de-a7a2-d69dd475248e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:40.461374 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-073692e4-df14-44de-a7a2-d69dd475248e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:40.468414 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-073692e4-df14-44de-a7a2-d69dd475248e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:40.468814 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-073692e4-df14-44de-a7a2-d69dd475248e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:40.469628 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-073692e4-df14-44de-a7a2-d69dd475248e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:40.470069 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-073692e4-df14-44de-a7a2-d69dd475248e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:40.519636 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a1d71cfc-480a-4a57-accc-aea8e1d20491 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:40.520332 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a1d71cfc-480a-4a57-accc-aea8e1d20491 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:40.526555 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a1d71cfc-480a-4a57-accc-aea8e1d20491 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:40.527008 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a1d71cfc-480a-4a57-accc-aea8e1d20491 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:40.527822 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a1d71cfc-480a-4a57-accc-aea8e1d20491 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:40.528262 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a1d71cfc-480a-4a57-accc-aea8e1d20491 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:40.642470 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-073692e4-df14-44de-a7a2-d69dd475248e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:40.650603 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-073692e4-df14-44de-a7a2-d69dd475248e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1321 microversion: 2.1 time: 0.193496 Feb 20 20:04:40.651268 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 80/152] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:40 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:40.708136 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a1d71cfc-480a-4a57-accc-aea8e1d20491 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:40.715859 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a1d71cfc-480a-4a57-accc-aea8e1d20491 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1362 microversion: 2.1 time: 0.200361 Feb 20 20:04:40.719337 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 73/153] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:40 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:04:41.027377 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-81d66ee3-9846-4829-9d05-d8e997b292e9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:41.027966 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-81d66ee3-9846-4829-9d05-d8e997b292e9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:41.034075 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-81d66ee3-9846-4829-9d05-d8e997b292e9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:41.034527 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-81d66ee3-9846-4829-9d05-d8e997b292e9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:41.035294 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-81d66ee3-9846-4829-9d05-d8e997b292e9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:41.035731 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-81d66ee3-9846-4829-9d05-d8e997b292e9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:41.170309 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-81d66ee3-9846-4829-9d05-d8e997b292e9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:41.178524 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-81d66ee3-9846-4829-9d05-d8e997b292e9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:41.180013 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-81d66ee3-9846-4829-9d05-d8e997b292e9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:41.181216 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-81d66ee3-9846-4829-9d05-d8e997b292e9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1408 microversion: 2.20 time: 0.157573 Feb 20 20:04:41.181783 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 81/154] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:41 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:04:41.668833 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-bd8d2840-c4ca-4e24-8a58-e25965bf0174 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:41.669471 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-bd8d2840-c4ca-4e24-8a58-e25965bf0174 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:41.676030 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bd8d2840-c4ca-4e24-8a58-e25965bf0174 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:41.676487 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bd8d2840-c4ca-4e24-8a58-e25965bf0174 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:41.677300 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bd8d2840-c4ca-4e24-8a58-e25965bf0174 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:41.677738 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bd8d2840-c4ca-4e24-8a58-e25965bf0174 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:41.735824 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-22216873-552a-4cd7-89e0-d8597085871a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:41.736425 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-22216873-552a-4cd7-89e0-d8597085871a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:41.742635 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-22216873-552a-4cd7-89e0-d8597085871a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:41.743086 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-22216873-552a-4cd7-89e0-d8597085871a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:41.743863 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-22216873-552a-4cd7-89e0-d8597085871a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:41.744297 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-22216873-552a-4cd7-89e0-d8597085871a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:41.842438 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-bd8d2840-c4ca-4e24-8a58-e25965bf0174 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:41.850378 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-bd8d2840-c4ca-4e24-8a58-e25965bf0174 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1321 microversion: 2.1 time: 0.185493 Feb 20 20:04:41.851070 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 74/155] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:41 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:41.907366 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-22216873-552a-4cd7-89e0-d8597085871a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:41.914629 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-22216873-552a-4cd7-89e0-d8597085871a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1362 microversion: 2.1 time: 0.183248 Feb 20 20:04:41.915562 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 82/156] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:41 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:04:42.198793 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-168149ad-91f8-4de1-a4eb-b5f124ef3d19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:42.199398 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-168149ad-91f8-4de1-a4eb-b5f124ef3d19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:42.206082 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-168149ad-91f8-4de1-a4eb-b5f124ef3d19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:42.206523 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-168149ad-91f8-4de1-a4eb-b5f124ef3d19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:42.207283 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-168149ad-91f8-4de1-a4eb-b5f124ef3d19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:42.207715 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-168149ad-91f8-4de1-a4eb-b5f124ef3d19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:42.342790 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-168149ad-91f8-4de1-a4eb-b5f124ef3d19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:42.351669 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-168149ad-91f8-4de1-a4eb-b5f124ef3d19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:42.353185 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-168149ad-91f8-4de1-a4eb-b5f124ef3d19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:42.354484 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-168149ad-91f8-4de1-a4eb-b5f124ef3d19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1408 microversion: 2.20 time: 0.159135 Feb 20 20:04:42.355155 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 75/157] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:42 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:04:42.382337 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-32ac18e7-e451-4f91-8893-2078c7aeb5b2 req-cd207c1d-093e-4d4d-9f00-4f228fce448d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6", "name": "network-vif-plugged", "status": "completed", "tag": "902a9701-9d4c-46bc-961e-7f1df743d7d7"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:04:42.383923 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:04:42.383923 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:04:42.391370 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-32ac18e7-e451-4f91-8893-2078c7aeb5b2 req-cd207c1d-093e-4d4d-9f00-4f228fce448d service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:42.391897 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-32ac18e7-e451-4f91-8893-2078c7aeb5b2 req-cd207c1d-093e-4d4d-9f00-4f228fce448d service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:42.402620 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-32ac18e7-e451-4f91-8893-2078c7aeb5b2 req-cd207c1d-093e-4d4d-9f00-4f228fce448d service nova] Creating event network-vif-plugged:902a9701-9d4c-46bc-961e-7f1df743d7d7 for instance ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 on hv-cinder-83008 Feb 20 20:04:42.407689 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-32ac18e7-e451-4f91-8893-2078c7aeb5b2 req-cd207c1d-093e-4d4d-9f00-4f228fce448d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028999 Feb 20 20:04:42.408365 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 83/158] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:04:42.867659 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-81756e5d-9ea6-4bfa-a923-9ce84f91accf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:42.868334 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-81756e5d-9ea6-4bfa-a923-9ce84f91accf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:42.874223 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-81756e5d-9ea6-4bfa-a923-9ce84f91accf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:42.874710 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-81756e5d-9ea6-4bfa-a923-9ce84f91accf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:42.875695 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-81756e5d-9ea6-4bfa-a923-9ce84f91accf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:42.876134 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-81756e5d-9ea6-4bfa-a923-9ce84f91accf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:42.933183 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-57bc85b1-52ee-4593-b993-68415cfd10bd tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:42.933925 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-57bc85b1-52ee-4593-b993-68415cfd10bd tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:42.940764 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-57bc85b1-52ee-4593-b993-68415cfd10bd tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:42.941342 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-57bc85b1-52ee-4593-b993-68415cfd10bd tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:42.944788 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-57bc85b1-52ee-4593-b993-68415cfd10bd tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:42.944788 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-57bc85b1-52ee-4593-b993-68415cfd10bd tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:43.060664 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-81756e5d-9ea6-4bfa-a923-9ce84f91accf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:43.068664 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-81756e5d-9ea6-4bfa-a923-9ce84f91accf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1321 microversion: 2.1 time: 0.204312 Feb 20 20:04:43.079335 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 76/159] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:42 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:43.117861 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-57bc85b1-52ee-4593-b993-68415cfd10bd tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:43.125449 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-57bc85b1-52ee-4593-b993-68415cfd10bd tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1362 microversion: 2.1 time: 0.196244 Feb 20 20:04:43.126166 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 84/160] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:42 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:43.371722 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ae83de0d-c8e6-4e8d-89c0-8ea604bab7ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:43.372554 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ae83de0d-c8e6-4e8d-89c0-8ea604bab7ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:43.379248 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ae83de0d-c8e6-4e8d-89c0-8ea604bab7ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:43.379773 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ae83de0d-c8e6-4e8d-89c0-8ea604bab7ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:43.380616 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ae83de0d-c8e6-4e8d-89c0-8ea604bab7ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:43.381147 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ae83de0d-c8e6-4e8d-89c0-8ea604bab7ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:43.516376 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ae83de0d-c8e6-4e8d-89c0-8ea604bab7ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:43.524084 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ae83de0d-c8e6-4e8d-89c0-8ea604bab7ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:43.525607 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ae83de0d-c8e6-4e8d-89c0-8ea604bab7ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:43.526688 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ae83de0d-c8e6-4e8d-89c0-8ea604bab7ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1408 microversion: 2.20 time: 0.158724 Feb 20 20:04:43.527254 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 77/161] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:43 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:04:44.085803 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f90aa4bc-a59a-40e2-8b14-d2280ac8a0df tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:44.086415 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f90aa4bc-a59a-40e2-8b14-d2280ac8a0df tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:44.093004 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f90aa4bc-a59a-40e2-8b14-d2280ac8a0df tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:44.094100 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f90aa4bc-a59a-40e2-8b14-d2280ac8a0df tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:44.094439 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f90aa4bc-a59a-40e2-8b14-d2280ac8a0df tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:44.094799 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f90aa4bc-a59a-40e2-8b14-d2280ac8a0df tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:44.143246 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6d6a3346-394d-4408-9b4c-8d8736d9a5f2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:44.143914 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6d6a3346-394d-4408-9b4c-8d8736d9a5f2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:44.149669 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6d6a3346-394d-4408-9b4c-8d8736d9a5f2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:44.150096 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6d6a3346-394d-4408-9b4c-8d8736d9a5f2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:44.150868 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6d6a3346-394d-4408-9b4c-8d8736d9a5f2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:44.151300 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6d6a3346-394d-4408-9b4c-8d8736d9a5f2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:44.302698 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f90aa4bc-a59a-40e2-8b14-d2280ac8a0df tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:44.310643 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f90aa4bc-a59a-40e2-8b14-d2280ac8a0df tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1321 microversion: 2.1 time: 0.228393 Feb 20 20:04:44.311507 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 85/162] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:44 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:44.395573 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6d6a3346-394d-4408-9b4c-8d8736d9a5f2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:44.407355 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6d6a3346-394d-4408-9b4c-8d8736d9a5f2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1362 microversion: 2.1 time: 0.268746 Feb 20 20:04:44.413833 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 78/163] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:44 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:04:44.544408 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a0f8d8ed-f135-4271-97a1-cc6975edb65f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:44.545011 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a0f8d8ed-f135-4271-97a1-cc6975edb65f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:44.551474 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a0f8d8ed-f135-4271-97a1-cc6975edb65f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:44.551919 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a0f8d8ed-f135-4271-97a1-cc6975edb65f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:44.552684 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a0f8d8ed-f135-4271-97a1-cc6975edb65f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:44.553151 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a0f8d8ed-f135-4271-97a1-cc6975edb65f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:44.686333 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a0f8d8ed-f135-4271-97a1-cc6975edb65f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:44.694249 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a0f8d8ed-f135-4271-97a1-cc6975edb65f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:44.695740 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a0f8d8ed-f135-4271-97a1-cc6975edb65f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:44.696823 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a0f8d8ed-f135-4271-97a1-cc6975edb65f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1408 microversion: 2.20 time: 0.156102 Feb 20 20:04:44.697427 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 86/164] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:44 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:04:45.328747 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-75738245-875c-4a72-b789-c33d7cf376a2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:45.329319 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-75738245-875c-4a72-b789-c33d7cf376a2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:45.335295 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-75738245-875c-4a72-b789-c33d7cf376a2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:45.335744 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-75738245-875c-4a72-b789-c33d7cf376a2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:45.336607 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-75738245-875c-4a72-b789-c33d7cf376a2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:45.337044 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-75738245-875c-4a72-b789-c33d7cf376a2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:45.425029 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-aa600864-7d9f-41d8-b4a9-e5562dda847b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:45.425659 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-aa600864-7d9f-41d8-b4a9-e5562dda847b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:45.432259 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aa600864-7d9f-41d8-b4a9-e5562dda847b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:45.432767 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aa600864-7d9f-41d8-b4a9-e5562dda847b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:45.433587 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aa600864-7d9f-41d8-b4a9-e5562dda847b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:45.434025 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aa600864-7d9f-41d8-b4a9-e5562dda847b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:45.474315 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-75738245-875c-4a72-b789-c33d7cf376a2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:45.482116 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-75738245-875c-4a72-b789-c33d7cf376a2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1321 microversion: 2.1 time: 0.157354 Feb 20 20:04:45.492433 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 79/165] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:45 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:45.576012 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-aa600864-7d9f-41d8-b4a9-e5562dda847b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:45.582144 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-aa600864-7d9f-41d8-b4a9-e5562dda847b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1362 microversion: 2.1 time: 0.161769 Feb 20 20:04:45.582659 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 87/166] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:45 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:04:45.715259 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-86f2063a-b97f-4263-ab91-d674b85596c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:45.716400 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-86f2063a-b97f-4263-ab91-d674b85596c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:45.722595 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-86f2063a-b97f-4263-ab91-d674b85596c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:45.723039 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-86f2063a-b97f-4263-ab91-d674b85596c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:45.723807 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-86f2063a-b97f-4263-ab91-d674b85596c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:45.724237 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-86f2063a-b97f-4263-ab91-d674b85596c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:45.856834 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-86f2063a-b97f-4263-ab91-d674b85596c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:45.864533 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-86f2063a-b97f-4263-ab91-d674b85596c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:45.866055 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-86f2063a-b97f-4263-ab91-d674b85596c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:45.867185 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-86f2063a-b97f-4263-ab91-d674b85596c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1601 microversion: 2.20 time: 0.156041 Feb 20 20:04:45.867740 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 80/167] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:04:45 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:04:45.884715 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ee2d35c7-7cfe-43ed-b068-705be2f0a2a2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:45.885347 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ee2d35c7-7cfe-43ed-b068-705be2f0a2a2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:45.894044 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ee2d35c7-7cfe-43ed-b068-705be2f0a2a2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:45.894489 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ee2d35c7-7cfe-43ed-b068-705be2f0a2a2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:45.895255 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ee2d35c7-7cfe-43ed-b068-705be2f0a2a2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:45.895687 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ee2d35c7-7cfe-43ed-b068-705be2f0a2a2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:45.977013 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ee2d35c7-7cfe-43ed-b068-705be2f0a2a2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095911 Feb 20 20:04:45.977641 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 88/168] 10.222.0.60 () {60 vars in 1315 bytes} [Sun Feb 20 20:04:45 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 20 20:04:46.498647 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-028cfb3a-7511-4d4f-80e9-cc95b0634499 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:46.499263 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-028cfb3a-7511-4d4f-80e9-cc95b0634499 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:46.506046 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-028cfb3a-7511-4d4f-80e9-cc95b0634499 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:46.506497 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-028cfb3a-7511-4d4f-80e9-cc95b0634499 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:46.507273 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-028cfb3a-7511-4d4f-80e9-cc95b0634499 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:46.507709 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-028cfb3a-7511-4d4f-80e9-cc95b0634499 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:46.599771 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4a478c9b-46af-4645-a150-c48954d96c48 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:46.600369 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4a478c9b-46af-4645-a150-c48954d96c48 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:46.606251 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4a478c9b-46af-4645-a150-c48954d96c48 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:46.606696 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4a478c9b-46af-4645-a150-c48954d96c48 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:46.609543 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4a478c9b-46af-4645-a150-c48954d96c48 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:46.609543 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4a478c9b-46af-4645-a150-c48954d96c48 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:46.844818 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-028cfb3a-7511-4d4f-80e9-cc95b0634499 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:46.852209 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-028cfb3a-7511-4d4f-80e9-cc95b0634499 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1321 microversion: 2.1 time: 0.357133 Feb 20 20:04:46.855627 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 81/169] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:46 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1321 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:46.910420 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4a478c9b-46af-4645-a150-c48954d96c48 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:46.917667 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4a478c9b-46af-4645-a150-c48954d96c48 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1362 microversion: 2.1 time: 0.321972 Feb 20 20:04:46.918321 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 89/170] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:46 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1362 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:47.527646 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-17f29bae-d823-4b6d-b6a0-676a72b294a5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:47.528263 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-17f29bae-d823-4b6d-b6a0-676a72b294a5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:47.530660 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-13ed97f0-de7f-4c63-950a-029964f7eaba req-ab44cf59-49d3-44df-9f69-3084d90ba4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97", "tag": "87a52ebd-35dd-4b56-8924-9578f176542c"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:04:47.533206 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:04:47.533206 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:04:47.534927 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-17f29bae-d823-4b6d-b6a0-676a72b294a5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:47.535361 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-17f29bae-d823-4b6d-b6a0-676a72b294a5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:47.536304 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-17f29bae-d823-4b6d-b6a0-676a72b294a5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:47.536876 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-17f29bae-d823-4b6d-b6a0-676a72b294a5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:47.540421 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-13ed97f0-de7f-4c63-950a-029964f7eaba req-ab44cf59-49d3-44df-9f69-3084d90ba4d7 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:47.540925 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-13ed97f0-de7f-4c63-950a-029964f7eaba req-ab44cf59-49d3-44df-9f69-3084d90ba4d7 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:47.554344 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-13ed97f0-de7f-4c63-950a-029964f7eaba req-ab44cf59-49d3-44df-9f69-3084d90ba4d7 service nova] Creating event network-changed:87a52ebd-35dd-4b56-8924-9578f176542c for instance d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 on hv-cinder-83008 Feb 20 20:04:47.559424 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-13ed97f0-de7f-4c63-950a-029964f7eaba req-ab44cf59-49d3-44df-9f69-3084d90ba4d7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032490 Feb 20 20:04:47.560465 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 90/171] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:04:47.600650 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-17f29bae-d823-4b6d-b6a0-676a72b294a5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/ips" status: 200 len: 113 microversion: 2.20 time: 0.076955 Feb 20 20:04:47.601227 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 82/172] 10.222.0.60 () {60 vars in 1288 bytes} [Sun Feb 20 20:04:47 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/ips => generated 113 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 20 20:04:47.870111 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f7ced725-8dca-43e4-923e-12722b0feb9d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:47.870916 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f7ced725-8dca-43e4-923e-12722b0feb9d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:47.877774 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f7ced725-8dca-43e4-923e-12722b0feb9d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:47.878216 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f7ced725-8dca-43e4-923e-12722b0feb9d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:47.878985 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f7ced725-8dca-43e4-923e-12722b0feb9d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:47.879407 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f7ced725-8dca-43e4-923e-12722b0feb9d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:47.936426 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2b316e76-59dc-4c9b-bbed-0b2d133e4e8b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:47.938742 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2b316e76-59dc-4c9b-bbed-0b2d133e4e8b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:47.957031 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2b316e76-59dc-4c9b-bbed-0b2d133e4e8b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:47.957710 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2b316e76-59dc-4c9b-bbed-0b2d133e4e8b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:47.958548 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2b316e76-59dc-4c9b-bbed-0b2d133e4e8b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:47.958984 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2b316e76-59dc-4c9b-bbed-0b2d133e4e8b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:48.041314 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f7ced725-8dca-43e4-923e-12722b0feb9d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:48.053396 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f7ced725-8dca-43e4-923e-12722b0feb9d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1321 microversion: 2.1 time: 0.187339 Feb 20 20:04:48.054140 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 91/173] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:47 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:48.247610 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2b316e76-59dc-4c9b-bbed-0b2d133e4e8b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:48.256153 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2b316e76-59dc-4c9b-bbed-0b2d133e4e8b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1362 microversion: 2.1 time: 0.323927 Feb 20 20:04:48.256732 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 83/174] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:47 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1362 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:04:49.071688 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a3a4454d-2274-475b-9322-50d033b5ffa6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:49.072309 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a3a4454d-2274-475b-9322-50d033b5ffa6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:49.079492 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a3a4454d-2274-475b-9322-50d033b5ffa6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:49.079946 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a3a4454d-2274-475b-9322-50d033b5ffa6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:49.080731 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a3a4454d-2274-475b-9322-50d033b5ffa6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:49.081211 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a3a4454d-2274-475b-9322-50d033b5ffa6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:49.274796 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-52e827a8-08d6-4e8d-9a91-2477467d7672 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:49.278300 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-52e827a8-08d6-4e8d-9a91-2477467d7672 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:49.285214 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-52e827a8-08d6-4e8d-9a91-2477467d7672 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:49.285933 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-52e827a8-08d6-4e8d-9a91-2477467d7672 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:49.288106 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-52e827a8-08d6-4e8d-9a91-2477467d7672 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:49.288701 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-52e827a8-08d6-4e8d-9a91-2477467d7672 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:49.319745 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a3a4454d-2274-475b-9322-50d033b5ffa6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:49.328146 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a3a4454d-2274-475b-9322-50d033b5ffa6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1321 microversion: 2.1 time: 0.259685 Feb 20 20:04:49.339281 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 92/175] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:49 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:49.474420 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-52e827a8-08d6-4e8d-9a91-2477467d7672 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:49.482296 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-52e827a8-08d6-4e8d-9a91-2477467d7672 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1362 microversion: 2.1 time: 0.212089 Feb 20 20:04:49.485488 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 84/176] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:49 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:04:50.347641 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d0da38ff-60d0-4946-8637-2d1902aa73b6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:50.348493 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d0da38ff-60d0-4946-8637-2d1902aa73b6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:50.354929 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d0da38ff-60d0-4946-8637-2d1902aa73b6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:50.355506 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d0da38ff-60d0-4946-8637-2d1902aa73b6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:50.356378 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d0da38ff-60d0-4946-8637-2d1902aa73b6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:50.356869 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d0da38ff-60d0-4946-8637-2d1902aa73b6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:50.509408 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-40fc70b0-a636-4161-abea-d8b9ffbf113a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:50.510273 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-40fc70b0-a636-4161-abea-d8b9ffbf113a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:50.523249 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-40fc70b0-a636-4161-abea-d8b9ffbf113a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:50.523700 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-40fc70b0-a636-4161-abea-d8b9ffbf113a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:50.524494 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-40fc70b0-a636-4161-abea-d8b9ffbf113a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:50.524980 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-40fc70b0-a636-4161-abea-d8b9ffbf113a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:50.535414 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d0da38ff-60d0-4946-8637-2d1902aa73b6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:50.542916 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d0da38ff-60d0-4946-8637-2d1902aa73b6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1516 microversion: 2.1 time: 0.200971 Feb 20 20:04:50.543492 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 93/177] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:50 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1516 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:50.560612 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5bd3f28a-edc0-4f5d-9562-98f51696e4b4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:04:50.561537 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5bd3f28a-edc0-4f5d-9562-98f51696e4b4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:50.568071 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5bd3f28a-edc0-4f5d-9562-98f51696e4b4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:50.571042 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5bd3f28a-edc0-4f5d-9562-98f51696e4b4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:50.571042 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5bd3f28a-edc0-4f5d-9562-98f51696e4b4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:50.571042 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5bd3f28a-edc0-4f5d-9562-98f51696e4b4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:50.599575 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-5bd3f28a-edc0-4f5d-9562-98f51696e4b4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lazy-loading 'flavor' on Instance uuid 52443e14-8400-4a24-8928-b6c1ccd822a5 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:04:50.674558 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-40fc70b0-a636-4161-abea-d8b9ffbf113a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:50.682078 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-40fc70b0-a636-4161-abea-d8b9ffbf113a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1547 microversion: 2.1 time: 0.183758 Feb 20 20:04:50.685325 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 85/178] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:50 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1547 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:50.698903 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-cdd47bbb-dc54-477a-b76e-7922fcb1fdb5 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:50.699395 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-cdd47bbb-dc54-477a-b76e-7922fcb1fdb5 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:50.705404 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cdd47bbb-dc54-477a-b76e-7922fcb1fdb5 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:50.705855 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cdd47bbb-dc54-477a-b76e-7922fcb1fdb5 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:50.706639 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cdd47bbb-dc54-477a-b76e-7922fcb1fdb5 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:50.707074 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cdd47bbb-dc54-477a-b76e-7922fcb1fdb5 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:50.788827 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-cdd47bbb-dc54-477a-b76e-7922fcb1fdb5 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093093 Feb 20 20:04:50.789535 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 86/179] 10.222.0.60 () {58 vars in 1274 bytes} [Sun Feb 20 20:04:50 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:04:51.011224 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5bd3f28a-edc0-4f5d-9562-98f51696e4b4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "POST /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5/action" status: 200 len: 32 microversion: 2.1 time: 0.449705 Feb 20 20:04:51.011224 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 94/180] 10.222.0.60 () {60 vars in 1277 bytes} [Sun Feb 20 20:04:50 2022] POST /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5/action => generated 32 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 20 20:04:51.018849 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1d44454b-0bbe-4cac-aed1-b011267a5b3a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:51.019498 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1d44454b-0bbe-4cac-aed1-b011267a5b3a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:51.038289 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1d44454b-0bbe-4cac-aed1-b011267a5b3a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:51.038767 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1d44454b-0bbe-4cac-aed1-b011267a5b3a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:51.039650 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1d44454b-0bbe-4cac-aed1-b011267a5b3a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:51.040543 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1d44454b-0bbe-4cac-aed1-b011267a5b3a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:51.429491 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1d44454b-0bbe-4cac-aed1-b011267a5b3a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:51.436907 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1d44454b-0bbe-4cac-aed1-b011267a5b3a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.424520 Feb 20 20:04:51.438672 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 87/181] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:51 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:52.455873 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7c200062-d407-4e42-a16b-a25cae40aea4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:52.457659 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7c200062-d407-4e42-a16b-a25cae40aea4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:52.472806 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7c200062-d407-4e42-a16b-a25cae40aea4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:52.478660 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7c200062-d407-4e42-a16b-a25cae40aea4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:52.478660 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7c200062-d407-4e42-a16b-a25cae40aea4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:52.478660 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7c200062-d407-4e42-a16b-a25cae40aea4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:52.725032 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-963af918-c2d6-4290-ba21-5ed0ce4a86d0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:52.725933 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-963af918-c2d6-4290-ba21-5ed0ce4a86d0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:52.736857 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-963af918-c2d6-4290-ba21-5ed0ce4a86d0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:52.737619 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-963af918-c2d6-4290-ba21-5ed0ce4a86d0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:52.740007 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-963af918-c2d6-4290-ba21-5ed0ce4a86d0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:52.741747 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-963af918-c2d6-4290-ba21-5ed0ce4a86d0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:52.796446 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-963af918-c2d6-4290-ba21-5ed0ce4a86d0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6/ips" status: 200 len: 105 microversion: 2.1 time: 0.075953 Feb 20 20:04:52.810948 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 88/182] 10.222.0.60 () {58 vars in 1247 bytes} [Sun Feb 20 20:04:52 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6/ips => generated 105 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:04:52.821566 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-7dac4a0e-a6dd-4bfc-a5ec-fdac4aa73764 req-b1c4896a-f3b1-437d-9187-b5a0a43c90e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6", "tag": "902a9701-9d4c-46bc-961e-7f1df743d7d7"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:04:52.823707 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:04:52.823707 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:04:52.836349 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-7dac4a0e-a6dd-4bfc-a5ec-fdac4aa73764 req-b1c4896a-f3b1-437d-9187-b5a0a43c90e6 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:52.836796 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-7dac4a0e-a6dd-4bfc-a5ec-fdac4aa73764 req-b1c4896a-f3b1-437d-9187-b5a0a43c90e6 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:52.858050 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-7dac4a0e-a6dd-4bfc-a5ec-fdac4aa73764 req-b1c4896a-f3b1-437d-9187-b5a0a43c90e6 service nova] Creating event network-changed:902a9701-9d4c-46bc-961e-7f1df743d7d7 for instance ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 on hv-cinder-83008 Feb 20 20:04:52.878142 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-7dac4a0e-a6dd-4bfc-a5ec-fdac4aa73764 req-b1c4896a-f3b1-437d-9187-b5a0a43c90e6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059781 Feb 20 20:04:52.878366 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7c200062-d407-4e42-a16b-a25cae40aea4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:52.879403 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 89/183] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:04:52.897355 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7c200062-d407-4e42-a16b-a25cae40aea4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.446599 Feb 20 20:04:52.898246 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 95/184] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:52 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:53.924795 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-0fcf1297-986d-4e81-b69a-9881f0f77814 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:53.926134 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-0fcf1297-986d-4e81-b69a-9881f0f77814 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:53.946175 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0fcf1297-986d-4e81-b69a-9881f0f77814 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:53.955706 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0fcf1297-986d-4e81-b69a-9881f0f77814 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:53.956605 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0fcf1297-986d-4e81-b69a-9881f0f77814 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:53.957053 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0fcf1297-986d-4e81-b69a-9881f0f77814 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:54.157541 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0fcf1297-986d-4e81-b69a-9881f0f77814 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:54.165234 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-0fcf1297-986d-4e81-b69a-9881f0f77814 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.247238 Feb 20 20:04:54.168970 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 90/185] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:53 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:55.185843 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-03663817-bcf2-4841-9ca0-cf7f558e5ed1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:55.187801 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-03663817-bcf2-4841-9ca0-cf7f558e5ed1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:55.195445 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-03663817-bcf2-4841-9ca0-cf7f558e5ed1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:55.195883 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-03663817-bcf2-4841-9ca0-cf7f558e5ed1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:55.196645 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-03663817-bcf2-4841-9ca0-cf7f558e5ed1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:55.197129 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-03663817-bcf2-4841-9ca0-cf7f558e5ed1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:55.391676 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-03663817-bcf2-4841-9ca0-cf7f558e5ed1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:55.401421 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-03663817-bcf2-4841-9ca0-cf7f558e5ed1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.219194 Feb 20 20:04:55.402516 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 96/186] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:55 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:56.421893 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2ab2e629-672c-4cc5-8469-384a066ebc40 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:56.422659 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2ab2e629-672c-4cc5-8469-384a066ebc40 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:56.428662 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ab2e629-672c-4cc5-8469-384a066ebc40 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:56.429382 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ab2e629-672c-4cc5-8469-384a066ebc40 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:56.430154 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ab2e629-672c-4cc5-8469-384a066ebc40 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:56.430583 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ab2e629-672c-4cc5-8469-384a066ebc40 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:56.578099 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2ab2e629-672c-4cc5-8469-384a066ebc40 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:56.586369 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2ab2e629-672c-4cc5-8469-384a066ebc40 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.168147 Feb 20 20:04:56.587006 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 91/187] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:56 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:57.604387 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7e4727f8-8219-451d-80c3-038c7bb01121 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:57.611840 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7e4727f8-8219-451d-80c3-038c7bb01121 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:57.611840 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7e4727f8-8219-451d-80c3-038c7bb01121 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:57.612956 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7e4727f8-8219-451d-80c3-038c7bb01121 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:57.613414 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7e4727f8-8219-451d-80c3-038c7bb01121 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:57.614157 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7e4727f8-8219-451d-80c3-038c7bb01121 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:57.758862 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7e4727f8-8219-451d-80c3-038c7bb01121 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:57.766413 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7e4727f8-8219-451d-80c3-038c7bb01121 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.166324 Feb 20 20:04:57.766988 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 97/188] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:57 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:58.710265 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f98e4a5f-2603-4779-a56b-a964849eed0c tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:58.710765 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f98e4a5f-2603-4779-a56b-a964849eed0c tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:58.716766 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f98e4a5f-2603-4779-a56b-a964849eed0c tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:58.717310 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f98e4a5f-2603-4779-a56b-a964849eed0c tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:58.718116 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f98e4a5f-2603-4779-a56b-a964849eed0c tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:58.718711 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f98e4a5f-2603-4779-a56b-a964849eed0c tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:58.743993 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f98e4a5f-2603-4779-a56b-a964849eed0c tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Going to try to terminate instance {{(pid=117087) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 20 20:04:58.783390 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-01eb44d5-40ca-4d33-ba65-584488b705f9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:58.783993 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-01eb44d5-40ca-4d33-ba65-584488b705f9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:58.790668 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-01eb44d5-40ca-4d33-ba65-584488b705f9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:58.791113 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-01eb44d5-40ca-4d33-ba65-584488b705f9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:58.791901 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-01eb44d5-40ca-4d33-ba65-584488b705f9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:58.792575 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-01eb44d5-40ca-4d33-ba65-584488b705f9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:58.982284 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-01eb44d5-40ca-4d33-ba65-584488b705f9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:58.990305 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-01eb44d5-40ca-4d33-ba65-584488b705f9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.210758 Feb 20 20:04:58.990868 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 98/189] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:58 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:04:59.116871 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f98e4a5f-2603-4779-a56b-a964849eed0c tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "DELETE /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 204 len: 0 microversion: 2.1 time: 0.409932 Feb 20 20:04:59.117611 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 92/190] 10.222.0.60 () {58 vars in 1238 bytes} [Sun Feb 20 20:04:58 2022] DELETE /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 20 20:04:59.125764 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-73b9a0a5-a956-4607-b902-6d42015008a7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:04:59.126504 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-73b9a0a5-a956-4607-b902-6d42015008a7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:04:59.132401 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-73b9a0a5-a956-4607-b902-6d42015008a7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:59.133013 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-73b9a0a5-a956-4607-b902-6d42015008a7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:59.134516 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-73b9a0a5-a956-4607-b902-6d42015008a7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:04:59.134950 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-73b9a0a5-a956-4607-b902-6d42015008a7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:04:59.305266 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-73b9a0a5-a956-4607-b902-6d42015008a7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:04:59.313422 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-73b9a0a5-a956-4607-b902-6d42015008a7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1553 microversion: 2.1 time: 0.191657 Feb 20 20:04:59.314000 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 99/191] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:04:59 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1553 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:00.007118 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-61b66488-beb3-4ddb-9105-0c724eaf380f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:00.007811 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-61b66488-beb3-4ddb-9105-0c724eaf380f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:00.013642 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-61b66488-beb3-4ddb-9105-0c724eaf380f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:00.014089 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-61b66488-beb3-4ddb-9105-0c724eaf380f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:00.015419 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-61b66488-beb3-4ddb-9105-0c724eaf380f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:00.016129 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-61b66488-beb3-4ddb-9105-0c724eaf380f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:00.155388 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-61b66488-beb3-4ddb-9105-0c724eaf380f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:00.163586 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-61b66488-beb3-4ddb-9105-0c724eaf380f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.160340 Feb 20 20:05:00.164147 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 93/192] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:00 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:00.330501 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0ea4c6c3-1790-4e8a-a1c1-99c1d32fc1ef tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:00.331119 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-0ea4c6c3-1790-4e8a-a1c1-99c1d32fc1ef tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:00.337457 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0ea4c6c3-1790-4e8a-a1c1-99c1d32fc1ef tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:00.337906 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0ea4c6c3-1790-4e8a-a1c1-99c1d32fc1ef tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:00.338681 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0ea4c6c3-1790-4e8a-a1c1-99c1d32fc1ef tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:00.339115 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0ea4c6c3-1790-4e8a-a1c1-99c1d32fc1ef tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:00.492509 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0ea4c6c3-1790-4e8a-a1c1-99c1d32fc1ef tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:00.501079 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-0ea4c6c3-1790-4e8a-a1c1-99c1d32fc1ef tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1553 microversion: 2.1 time: 0.174113 Feb 20 20:05:00.501583 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 100/193] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:00 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:01.181814 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8777ea79-0961-4e5f-8796-4600161c83f1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:01.185571 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8777ea79-0961-4e5f-8796-4600161c83f1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:01.188356 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8777ea79-0961-4e5f-8796-4600161c83f1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:01.188941 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8777ea79-0961-4e5f-8796-4600161c83f1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:01.192717 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8777ea79-0961-4e5f-8796-4600161c83f1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:01.193194 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8777ea79-0961-4e5f-8796-4600161c83f1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:01.540878 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8777ea79-0961-4e5f-8796-4600161c83f1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:01.540878 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8777ea79-0961-4e5f-8796-4600161c83f1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.159429 Feb 20 20:05:01.540878 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 94/194] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:01 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:01.541227 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7ea2f4b6-969c-4928-bc15-df2eff849998 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:01.541227 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7ea2f4b6-969c-4928-bc15-df2eff849998 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:01.541227 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7ea2f4b6-969c-4928-bc15-df2eff849998 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:01.541227 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7ea2f4b6-969c-4928-bc15-df2eff849998 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:01.541902 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7ea2f4b6-969c-4928-bc15-df2eff849998 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:01.541902 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7ea2f4b6-969c-4928-bc15-df2eff849998 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:01.674701 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7ea2f4b6-969c-4928-bc15-df2eff849998 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:01.689393 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7ea2f4b6-969c-4928-bc15-df2eff849998 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1553 microversion: 2.1 time: 0.169271 Feb 20 20:05:01.689393 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 101/195] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:01 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:02.547948 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-57eac8a7-2ce4-4b9a-b8d6-3bbe8f514ec2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:02.548608 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-57eac8a7-2ce4-4b9a-b8d6-3bbe8f514ec2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:02.554358 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-57eac8a7-2ce4-4b9a-b8d6-3bbe8f514ec2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:02.554797 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-57eac8a7-2ce4-4b9a-b8d6-3bbe8f514ec2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:02.555556 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-57eac8a7-2ce4-4b9a-b8d6-3bbe8f514ec2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:02.556066 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-57eac8a7-2ce4-4b9a-b8d6-3bbe8f514ec2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:02.691342 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-57eac8a7-2ce4-4b9a-b8d6-3bbe8f514ec2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:02.704909 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-1d793cc4-890d-49f8-805c-83654b84df26 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:02.706276 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-1d793cc4-890d-49f8-805c-83654b84df26 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:02.711557 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-57eac8a7-2ce4-4b9a-b8d6-3bbe8f514ec2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.154636 Feb 20 20:05:02.712636 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 95/196] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:02 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:02.724912 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1d793cc4-890d-49f8-805c-83654b84df26 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:02.725412 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1d793cc4-890d-49f8-805c-83654b84df26 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:02.726273 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1d793cc4-890d-49f8-805c-83654b84df26 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:02.729732 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1d793cc4-890d-49f8-805c-83654b84df26 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:02.870898 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-1d793cc4-890d-49f8-805c-83654b84df26 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:02.879564 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-1d793cc4-890d-49f8-805c-83654b84df26 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1553 microversion: 2.1 time: 0.179523 Feb 20 20:05:02.880132 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 102/197] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:02 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1553 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:05:03.730045 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f527ee88-d922-466f-9b0e-87f2bdddde55 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:03.730590 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f527ee88-d922-466f-9b0e-87f2bdddde55 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:03.737692 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f527ee88-d922-466f-9b0e-87f2bdddde55 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:03.738187 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f527ee88-d922-466f-9b0e-87f2bdddde55 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:03.739797 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f527ee88-d922-466f-9b0e-87f2bdddde55 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:03.739797 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f527ee88-d922-466f-9b0e-87f2bdddde55 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:03.896208 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2e572061-b03d-4ab6-b241-816c14447b3c tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:03.897671 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2e572061-b03d-4ab6-b241-816c14447b3c tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:03.903298 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f527ee88-d922-466f-9b0e-87f2bdddde55 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:03.906711 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2e572061-b03d-4ab6-b241-816c14447b3c tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:03.908320 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2e572061-b03d-4ab6-b241-816c14447b3c tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:03.909142 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2e572061-b03d-4ab6-b241-816c14447b3c tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:03.909587 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2e572061-b03d-4ab6-b241-816c14447b3c tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:03.911950 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f527ee88-d922-466f-9b0e-87f2bdddde55 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.185694 Feb 20 20:05:03.912757 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 96/198] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:03 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:04.095528 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2e572061-b03d-4ab6-b241-816c14447b3c tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:04.108213 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2e572061-b03d-4ab6-b241-816c14447b3c tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1553 microversion: 2.1 time: 0.216033 Feb 20 20:05:04.110192 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 103/199] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:03 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1553 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:05:04.843175 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-56a47cb3-c74b-40d6-951e-09fc56b00654 req-e7bc927c-5b34-47f0-befc-a35a3a52ebc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27be4751-a3cc-4912-8cc9-fb61d611698d", "name": "network-vif-deleted", "tag": "d256f7e8-1d52-4116-97eb-a03ae94013f4"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:05:04.845765 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:05:04.845765 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:05:04.852524 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-56a47cb3-c74b-40d6-951e-09fc56b00654 req-e7bc927c-5b34-47f0-befc-a35a3a52ebc4 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:04.852524 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-56a47cb3-c74b-40d6-951e-09fc56b00654 req-e7bc927c-5b34-47f0-befc-a35a3a52ebc4 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:04.864860 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-56a47cb3-c74b-40d6-951e-09fc56b00654 req-e7bc927c-5b34-47f0-befc-a35a3a52ebc4 service nova] Creating event network-vif-deleted:d256f7e8-1d52-4116-97eb-a03ae94013f4 for instance 27be4751-a3cc-4912-8cc9-fb61d611698d on hv-cinder-83008 Feb 20 20:05:04.881241 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-56a47cb3-c74b-40d6-951e-09fc56b00654 req-e7bc927c-5b34-47f0-befc-a35a3a52ebc4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043186 Feb 20 20:05:04.881241 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 97/200] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:05:04.939774 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-dca34986-4a1a-4910-87d6-02a55e074e92 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:04.944968 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-dca34986-4a1a-4910-87d6-02a55e074e92 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:04.952359 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dca34986-4a1a-4910-87d6-02a55e074e92 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:04.953196 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dca34986-4a1a-4910-87d6-02a55e074e92 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:04.954909 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dca34986-4a1a-4910-87d6-02a55e074e92 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:04.955506 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dca34986-4a1a-4910-87d6-02a55e074e92 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:05.107608 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-dca34986-4a1a-4910-87d6-02a55e074e92 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:05.115086 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-dca34986-4a1a-4910-87d6-02a55e074e92 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.188113 Feb 20 20:05:05.115664 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 104/201] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:04 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:05.128028 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ee564b04-fd7c-4aa3-b44e-e64f56de8a8e tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:05.128719 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ee564b04-fd7c-4aa3-b44e-e64f56de8a8e tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:05.134995 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ee564b04-fd7c-4aa3-b44e-e64f56de8a8e tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:05.135632 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ee564b04-fd7c-4aa3-b44e-e64f56de8a8e tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:05.136410 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ee564b04-fd7c-4aa3-b44e-e64f56de8a8e tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:05.136840 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ee564b04-fd7c-4aa3-b44e-e64f56de8a8e tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:05.209743 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ee564b04-fd7c-4aa3-b44e-e64f56de8a8e tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:05.218596 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ee564b04-fd7c-4aa3-b44e-e64f56de8a8e tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1346 microversion: 2.1 time: 0.095518 Feb 20 20:05:05.219313 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 98/202] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:05 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1346 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:06.132321 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9e8337bf-7e59-4c68-8ce1-27201ee94902 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:06.132935 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9e8337bf-7e59-4c68-8ce1-27201ee94902 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:06.138806 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9e8337bf-7e59-4c68-8ce1-27201ee94902 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:06.139276 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9e8337bf-7e59-4c68-8ce1-27201ee94902 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:06.143890 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9e8337bf-7e59-4c68-8ce1-27201ee94902 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:06.143890 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9e8337bf-7e59-4c68-8ce1-27201ee94902 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:06.237688 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-81f1799e-bb82-4961-8263-31ab671dcf3d tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:06.238308 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-81f1799e-bb82-4961-8263-31ab671dcf3d tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:06.244831 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-81f1799e-bb82-4961-8263-31ab671dcf3d tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:06.245306 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-81f1799e-bb82-4961-8263-31ab671dcf3d tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:06.246081 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-81f1799e-bb82-4961-8263-31ab671dcf3d tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:06.246696 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-81f1799e-bb82-4961-8263-31ab671dcf3d tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:06.285810 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-81f1799e-bb82-4961-8263-31ab671dcf3d tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:06.286530 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-81f1799e-bb82-4961-8263-31ab671dcf3d tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:06.286862 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-81f1799e-bb82-4961-8263-31ab671dcf3d tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lazy-loading 'fault' on Instance uuid 27be4751-a3cc-4912-8cc9-fb61d611698d {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:05:06.306080 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9e8337bf-7e59-4c68-8ce1-27201ee94902 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:06.315014 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9e8337bf-7e59-4c68-8ce1-27201ee94902 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.186650 Feb 20 20:05:06.315688 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 105/203] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:06 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:06.339252 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-81f1799e-bb82-4961-8263-31ab671dcf3d tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e42677567d418c84d335c9bfb42c55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1818d276f14d708be99c940260b757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:06.348008 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-81f1799e-bb82-4961-8263-31ab671dcf3d tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 200 len: 1351 microversion: 2.1 time: 0.115127 Feb 20 20:05:06.348575 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 99/204] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:06 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 1351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:05:07.332107 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-986e9db3-39a7-420c-ba2a-0dd85315e1d6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:07.332886 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-986e9db3-39a7-420c-ba2a-0dd85315e1d6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:07.339041 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-986e9db3-39a7-420c-ba2a-0dd85315e1d6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:07.339734 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-986e9db3-39a7-420c-ba2a-0dd85315e1d6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:07.340495 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-986e9db3-39a7-420c-ba2a-0dd85315e1d6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:07.340923 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-986e9db3-39a7-420c-ba2a-0dd85315e1d6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:07.365240 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d51c5cc6-6b1b-4e8f-a9c8-15587ea364a2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:07.365907 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d51c5cc6-6b1b-4e8f-a9c8-15587ea364a2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:07.374412 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d51c5cc6-6b1b-4e8f-a9c8-15587ea364a2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:07.376904 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d51c5cc6-6b1b-4e8f-a9c8-15587ea364a2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:07.376904 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d51c5cc6-6b1b-4e8f-a9c8-15587ea364a2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:07.382301 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d51c5cc6-6b1b-4e8f-a9c8-15587ea364a2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:07.400493 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-d51c5cc6-6b1b-4e8f-a9c8-15587ea364a2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] HTTP exception thrown: Instance 27be4751-a3cc-4912-8cc9-fb61d611698d could not be found. Feb 20 20:05:07.401213 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d51c5cc6-6b1b-4e8f-a9c8-15587ea364a2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Returning 404 to user: Instance 27be4751-a3cc-4912-8cc9-fb61d611698d could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:05:07.405533 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d51c5cc6-6b1b-4e8f-a9c8-15587ea364a2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 404 len: 111 microversion: 2.1 time: 0.040478 Feb 20 20:05:07.405533 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 100/205] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:07 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:05:07.478733 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-986e9db3-39a7-420c-ba2a-0dd85315e1d6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:07.486116 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-986e9db3-39a7-420c-ba2a-0dd85315e1d6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.158344 Feb 20 20:05:07.486683 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 106/206] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:07 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:07.621973 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f497502b-9f94-4445-8da7-3d0274a4176e tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:07.623070 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f497502b-9f94-4445-8da7-3d0274a4176e tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:07.630087 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f497502b-9f94-4445-8da7-3d0274a4176e tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:07.630688 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f497502b-9f94-4445-8da7-3d0274a4176e tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:07.631722 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f497502b-9f94-4445-8da7-3d0274a4176e tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:07.632304 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f497502b-9f94-4445-8da7-3d0274a4176e tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:07.645592 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-f497502b-9f94-4445-8da7-3d0274a4176e tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] HTTP exception thrown: Instance 27be4751-a3cc-4912-8cc9-fb61d611698d could not be found. Feb 20 20:05:07.646201 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f497502b-9f94-4445-8da7-3d0274a4176e tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Returning 404 to user: Instance 27be4751-a3cc-4912-8cc9-fb61d611698d could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:05:07.647057 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f497502b-9f94-4445-8da7-3d0274a4176e tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029000 Feb 20 20:05:07.647599 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 101/207] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:05:07 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:05:08.503061 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7a482353-a835-477a-bcc9-df2ab82ac91d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:08.504187 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7a482353-a835-477a-bcc9-df2ab82ac91d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:08.510510 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7a482353-a835-477a-bcc9-df2ab82ac91d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:08.510958 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7a482353-a835-477a-bcc9-df2ab82ac91d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:08.511737 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7a482353-a835-477a-bcc9-df2ab82ac91d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:08.512172 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7a482353-a835-477a-bcc9-df2ab82ac91d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:08.648780 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7a482353-a835-477a-bcc9-df2ab82ac91d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:08.656114 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7a482353-a835-477a-bcc9-df2ab82ac91d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.156653 Feb 20 20:05:08.656671 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 107/208] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:08 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:09.089813 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7927329f-4310-4e19-8e37-3fc4f3c4dff7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:09.091881 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7927329f-4310-4e19-8e37-3fc4f3c4dff7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:09.096377 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7927329f-4310-4e19-8e37-3fc4f3c4dff7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:09.096830 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7927329f-4310-4e19-8e37-3fc4f3c4dff7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:09.097671 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7927329f-4310-4e19-8e37-3fc4f3c4dff7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:09.098107 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7927329f-4310-4e19-8e37-3fc4f3c4dff7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:09.112555 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-7927329f-4310-4e19-8e37-3fc4f3c4dff7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] HTTP exception thrown: Instance 27be4751-a3cc-4912-8cc9-fb61d611698d could not be found. Feb 20 20:05:09.113319 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7927329f-4310-4e19-8e37-3fc4f3c4dff7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Returning 404 to user: Instance 27be4751-a3cc-4912-8cc9-fb61d611698d could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:05:09.114222 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7927329f-4310-4e19-8e37-3fc4f3c4dff7 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "DELETE /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 404 len: 111 microversion: 2.1 time: 0.028314 Feb 20 20:05:09.114785 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 102/209] 10.222.0.60 () {58 vars in 1238 bytes} [Sun Feb 20 20:05:09 2022] DELETE /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:05:09.123583 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-64cd1c81-3d50-443f-95d7-287b59d677d2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:09.124379 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-64cd1c81-3d50-443f-95d7-287b59d677d2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] [instance: 27be4751-a3cc-4912-8cc9-fb61d611698d] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:09.131236 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-64cd1c81-3d50-443f-95d7-287b59d677d2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:09.131697 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-64cd1c81-3d50-443f-95d7-287b59d677d2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:09.132486 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-64cd1c81-3d50-443f-95d7-287b59d677d2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:09.132905 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-64cd1c81-3d50-443f-95d7-287b59d677d2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:09.147611 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-64cd1c81-3d50-443f-95d7-287b59d677d2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] HTTP exception thrown: Instance 27be4751-a3cc-4912-8cc9-fb61d611698d could not be found. Feb 20 20:05:09.148298 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-64cd1c81-3d50-443f-95d7-287b59d677d2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] Returning 404 to user: Instance 27be4751-a3cc-4912-8cc9-fb61d611698d could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:05:09.149187 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-64cd1c81-3d50-443f-95d7-287b59d677d2 tempest-DeleteServersTestJSON-102909113 tempest-DeleteServersTestJSON-102909113-project] 10.222.0.60 "GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d" status: 404 len: 111 microversion: 2.1 time: 0.029194 Feb 20 20:05:09.154564 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 108/210] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:09 2022] GET /compute/v2.1/servers/27be4751-a3cc-4912-8cc9-fb61d611698d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 20 20:05:09.675067 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d2a46154-06be-43dd-a5b6-5a1c612dc11c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:09.675645 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d2a46154-06be-43dd-a5b6-5a1c612dc11c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:09.681414 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d2a46154-06be-43dd-a5b6-5a1c612dc11c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:09.681853 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d2a46154-06be-43dd-a5b6-5a1c612dc11c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:09.682781 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d2a46154-06be-43dd-a5b6-5a1c612dc11c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:09.683052 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d2a46154-06be-43dd-a5b6-5a1c612dc11c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:09.874266 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d2a46154-06be-43dd-a5b6-5a1c612dc11c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:09.881655 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d2a46154-06be-43dd-a5b6-5a1c612dc11c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.211082 Feb 20 20:05:09.882233 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 103/211] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:09 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:10.899474 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6d0d9fa6-fd6f-42e2-9c5d-7a628bb06c9c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:10.900098 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6d0d9fa6-fd6f-42e2-9c5d-7a628bb06c9c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:10.906633 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6d0d9fa6-fd6f-42e2-9c5d-7a628bb06c9c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:10.907127 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6d0d9fa6-fd6f-42e2-9c5d-7a628bb06c9c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:10.907996 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6d0d9fa6-fd6f-42e2-9c5d-7a628bb06c9c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:10.908598 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6d0d9fa6-fd6f-42e2-9c5d-7a628bb06c9c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:11.049604 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6d0d9fa6-fd6f-42e2-9c5d-7a628bb06c9c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:11.057395 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6d0d9fa6-fd6f-42e2-9c5d-7a628bb06c9c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.162302 Feb 20 20:05:11.058411 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 109/212] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:10 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:12.075820 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0d91c088-3a9b-426e-87ef-d4790fd7afda tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:12.077891 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-0d91c088-3a9b-426e-87ef-d4790fd7afda tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:12.085295 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0d91c088-3a9b-426e-87ef-d4790fd7afda tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:12.085975 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0d91c088-3a9b-426e-87ef-d4790fd7afda tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:12.087052 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0d91c088-3a9b-426e-87ef-d4790fd7afda tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:12.087484 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0d91c088-3a9b-426e-87ef-d4790fd7afda tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:12.168696 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-15034953-0e57-4920-87b9-3d8a1c7ce4e1 tempest-VolumesGetTestJSON-1388090365 tempest-VolumesGetTestJSON-1388090365-project] Action: 'create', calling method: .version_select at 0x7fdd91872dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1991176099", "metadata": {"Type": "work"}}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:05:12.269761 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0d91c088-3a9b-426e-87ef-d4790fd7afda tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:12.281392 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-0d91c088-3a9b-426e-87ef-d4790fd7afda tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.209671 Feb 20 20:05:12.292475 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 110/213] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:12 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:13.137107 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-15034953-0e57-4920-87b9-3d8a1c7ce4e1 tempest-VolumesGetTestJSON-1388090365 tempest-VolumesGetTestJSON-1388090365-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.110689 Feb 20 20:05:13.138508 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 104/214] 10.222.0.60 () {60 vars in 1155 bytes} [Sun Feb 20 20:05:12 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1112 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 20 20:05:13.151429 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-831aa51a-c7d5-4414-a26e-59882894f49f tempest-VolumesGetTestJSON-1388090365 tempest-VolumesGetTestJSON-1388090365-project] Calling method '.version_select at 0x7fdd9180b700>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:13.242447 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-831aa51a-c7d5-4414-a26e-59882894f49f tempest-VolumesGetTestJSON-1388090365 tempest-VolumesGetTestJSON-1388090365-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/e5c47dc3-b055-47ab-82fe-b3bc6994f22f" status: 200 len: 353 microversion: 2.1 time: 0.096065 Feb 20 20:05:13.247307 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 111/215] 10.222.0.60 () {58 vars in 1244 bytes} [Sun Feb 20 20:05:13 2022] GET /compute/v2.1/os-volumes/e5c47dc3-b055-47ab-82fe-b3bc6994f22f => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:05:13.303567 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b9145468-e8bb-4428-8428-151f41c4f2b7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:13.304958 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b9145468-e8bb-4428-8428-151f41c4f2b7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:13.311711 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b9145468-e8bb-4428-8428-151f41c4f2b7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:13.312156 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b9145468-e8bb-4428-8428-151f41c4f2b7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:13.313122 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b9145468-e8bb-4428-8428-151f41c4f2b7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:13.313727 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b9145468-e8bb-4428-8428-151f41c4f2b7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:13.502105 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b9145468-e8bb-4428-8428-151f41c4f2b7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:13.509590 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b9145468-e8bb-4428-8428-151f41c4f2b7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.213069 Feb 20 20:05:13.510570 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 105/216] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:13 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:14.256116 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ede204a1-46c1-40c5-89a4-87103254a6b4 tempest-VolumesGetTestJSON-1388090365 tempest-VolumesGetTestJSON-1388090365-project] Calling method '.version_select at 0x7fdd920b7c10>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:14.313444 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ede204a1-46c1-40c5-89a4-87103254a6b4 tempest-VolumesGetTestJSON-1388090365 tempest-VolumesGetTestJSON-1388090365-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/e5c47dc3-b055-47ab-82fe-b3bc6994f22f" status: 200 len: 354 microversion: 2.1 time: 0.061245 Feb 20 20:05:14.314445 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 112/217] 10.222.0.60 () {58 vars in 1244 bytes} [Sun Feb 20 20:05:14 2022] GET /compute/v2.1/os-volumes/e5c47dc3-b055-47ab-82fe-b3bc6994f22f => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:05:14.329780 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ebf37061-cc45-467e-a0cf-23cd00d4eea4 tempest-VolumesGetTestJSON-1388090365 tempest-VolumesGetTestJSON-1388090365-project] Calling method '.version_select at 0x7fdd918c9ca0>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:14.394386 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ebf37061-cc45-467e-a0cf-23cd00d4eea4 tempest-VolumesGetTestJSON-1388090365 tempest-VolumesGetTestJSON-1388090365-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/e5c47dc3-b055-47ab-82fe-b3bc6994f22f" status: 200 len: 354 microversion: 2.1 time: 0.069534 Feb 20 20:05:14.394952 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 106/218] 10.222.0.60 () {58 vars in 1244 bytes} [Sun Feb 20 20:05:14 2022] GET /compute/v2.1/os-volumes/e5c47dc3-b055-47ab-82fe-b3bc6994f22f => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:05:14.410801 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a336d814-33a3-4b0b-8e15-ee1664437428 tempest-VolumesGetTestJSON-1388090365 tempest-VolumesGetTestJSON-1388090365-project] Calling method '.version_select at 0x7fdd917774c0>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:14.541947 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-fe5e8372-0f8f-4e6a-abc6-e09d10ebcbd9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:14.542636 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-fe5e8372-0f8f-4e6a-abc6-e09d10ebcbd9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:14.548642 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fe5e8372-0f8f-4e6a-abc6-e09d10ebcbd9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:14.549556 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fe5e8372-0f8f-4e6a-abc6-e09d10ebcbd9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:14.550530 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fe5e8372-0f8f-4e6a-abc6-e09d10ebcbd9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:14.551098 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fe5e8372-0f8f-4e6a-abc6-e09d10ebcbd9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:14.682079 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a336d814-33a3-4b0b-8e15-ee1664437428 tempest-VolumesGetTestJSON-1388090365 tempest-VolumesGetTestJSON-1388090365-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/e5c47dc3-b055-47ab-82fe-b3bc6994f22f" status: 202 len: 0 microversion: 2.1 time: 0.272161 Feb 20 20:05:14.682079 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 113/219] 10.222.0.60 () {58 vars in 1247 bytes} [Sun Feb 20 20:05:14 2022] DELETE /compute/v2.1/os-volumes/e5c47dc3-b055-47ab-82fe-b3bc6994f22f => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:05:14.689072 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-220edf59-3ed6-44d7-a54c-afa66d01ed21 tempest-VolumesGetTestJSON-1388090365 tempest-VolumesGetTestJSON-1388090365-project] Calling method '.version_select at 0x7fdd91777940>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:14.723639 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-fe5e8372-0f8f-4e6a-abc6-e09d10ebcbd9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:14.736756 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-fe5e8372-0f8f-4e6a-abc6-e09d10ebcbd9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.198236 Feb 20 20:05:14.737398 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 107/220] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:14 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:05:14.776282 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-220edf59-3ed6-44d7-a54c-afa66d01ed21 tempest-VolumesGetTestJSON-1388090365 tempest-VolumesGetTestJSON-1388090365-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/e5c47dc3-b055-47ab-82fe-b3bc6994f22f" status: 200 len: 353 microversion: 2.1 time: 0.092196 Feb 20 20:05:14.778164 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 114/221] 10.222.0.60 () {58 vars in 1244 bytes} [Sun Feb 20 20:05:14 2022] GET /compute/v2.1/os-volumes/e5c47dc3-b055-47ab-82fe-b3bc6994f22f => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:05:15.755325 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-37a2412e-b1d4-4a5d-929a-a5eab74b6090 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:15.755921 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-37a2412e-b1d4-4a5d-929a-a5eab74b6090 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:15.761851 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-37a2412e-b1d4-4a5d-929a-a5eab74b6090 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:15.762332 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-37a2412e-b1d4-4a5d-929a-a5eab74b6090 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:15.763155 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-37a2412e-b1d4-4a5d-929a-a5eab74b6090 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:15.763586 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-37a2412e-b1d4-4a5d-929a-a5eab74b6090 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:15.793321 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-015ddcff-ed08-4c72-997a-32ecd7cda4da tempest-VolumesGetTestJSON-1388090365 tempest-VolumesGetTestJSON-1388090365-project] Calling method '.version_select at 0x7fdd920ab820>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:15.823341 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-015ddcff-ed08-4c72-997a-32ecd7cda4da tempest-VolumesGetTestJSON-1388090365 tempest-VolumesGetTestJSON-1388090365-project] HTTP exception thrown: Volume e5c47dc3-b055-47ab-82fe-b3bc6994f22f could not be found. Feb 20 20:05:15.824166 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-015ddcff-ed08-4c72-997a-32ecd7cda4da tempest-VolumesGetTestJSON-1388090365 tempest-VolumesGetTestJSON-1388090365-project] Returning 404 to user: Volume e5c47dc3-b055-47ab-82fe-b3bc6994f22f could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:05:15.825119 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-015ddcff-ed08-4c72-997a-32ecd7cda4da tempest-VolumesGetTestJSON-1388090365 tempest-VolumesGetTestJSON-1388090365-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/e5c47dc3-b055-47ab-82fe-b3bc6994f22f" status: 404 len: 109 microversion: 2.1 time: 0.037951 Feb 20 20:05:15.825775 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 115/222] 10.222.0.60 () {58 vars in 1244 bytes} [Sun Feb 20 20:05:15 2022] GET /compute/v2.1/os-volumes/e5c47dc3-b055-47ab-82fe-b3bc6994f22f => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 20 20:05:15.943449 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-37a2412e-b1d4-4a5d-929a-a5eab74b6090 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:15.951532 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-37a2412e-b1d4-4a5d-929a-a5eab74b6090 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.200851 Feb 20 20:05:15.952119 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 108/223] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:15 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:16.969251 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-53d823a7-110a-4847-ba7b-b7ed388305b9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:16.969964 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-53d823a7-110a-4847-ba7b-b7ed388305b9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:16.979689 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-53d823a7-110a-4847-ba7b-b7ed388305b9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:16.979941 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-53d823a7-110a-4847-ba7b-b7ed388305b9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:16.980947 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-53d823a7-110a-4847-ba7b-b7ed388305b9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:16.981574 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-53d823a7-110a-4847-ba7b-b7ed388305b9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:17.580994 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-53d823a7-110a-4847-ba7b-b7ed388305b9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:17.589140 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-53d823a7-110a-4847-ba7b-b7ed388305b9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.624896 Feb 20 20:05:17.590083 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 116/224] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:16 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:18.607963 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b3a0fb30-42df-452a-858a-469f424b1c36 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:18.609170 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b3a0fb30-42df-452a-858a-469f424b1c36 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:18.615869 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b3a0fb30-42df-452a-858a-469f424b1c36 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:18.620629 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b3a0fb30-42df-452a-858a-469f424b1c36 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:18.620629 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b3a0fb30-42df-452a-858a-469f424b1c36 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:18.620629 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b3a0fb30-42df-452a-858a-469f424b1c36 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:18.821704 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b3a0fb30-42df-452a-858a-469f424b1c36 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:18.836363 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b3a0fb30-42df-452a-858a-469f424b1c36 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.231725 Feb 20 20:05:18.855953 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 109/225] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:18 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:19.860328 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-73ec866c-827d-440c-9a09-a96ad28c1533 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:19.860937 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-73ec866c-827d-440c-9a09-a96ad28c1533 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:19.867688 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-73ec866c-827d-440c-9a09-a96ad28c1533 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:19.868167 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-73ec866c-827d-440c-9a09-a96ad28c1533 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:19.869346 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-73ec866c-827d-440c-9a09-a96ad28c1533 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:19.869784 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-73ec866c-827d-440c-9a09-a96ad28c1533 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:20.024533 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-73ec866c-827d-440c-9a09-a96ad28c1533 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:20.033626 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-73ec866c-827d-440c-9a09-a96ad28c1533 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.177200 Feb 20 20:05:20.034215 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 117/226] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:19 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:21.050695 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8da1e689-c833-4a53-b792-ddd5b01f39cd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:21.051526 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8da1e689-c833-4a53-b792-ddd5b01f39cd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:21.057919 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8da1e689-c833-4a53-b792-ddd5b01f39cd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:21.058452 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8da1e689-c833-4a53-b792-ddd5b01f39cd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:21.059318 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8da1e689-c833-4a53-b792-ddd5b01f39cd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:21.059856 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8da1e689-c833-4a53-b792-ddd5b01f39cd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:21.227330 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8da1e689-c833-4a53-b792-ddd5b01f39cd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:21.235362 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8da1e689-c833-4a53-b792-ddd5b01f39cd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.188476 Feb 20 20:05:21.235955 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 110/227] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:21 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:22.257486 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5ba4bf5e-cd43-405c-9c8d-2d06cde91bcb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:22.258669 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5ba4bf5e-cd43-405c-9c8d-2d06cde91bcb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:22.264639 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5ba4bf5e-cd43-405c-9c8d-2d06cde91bcb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:22.265115 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5ba4bf5e-cd43-405c-9c8d-2d06cde91bcb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:22.266421 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5ba4bf5e-cd43-405c-9c8d-2d06cde91bcb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:22.266855 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5ba4bf5e-cd43-405c-9c8d-2d06cde91bcb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:22.523117 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5ba4bf5e-cd43-405c-9c8d-2d06cde91bcb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:22.536204 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5ba4bf5e-cd43-405c-9c8d-2d06cde91bcb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.286700 Feb 20 20:05:22.549391 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 118/228] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:22 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:23.568253 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-416ed35d-7d95-4005-9d2a-3712521fb9d0 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:23.569032 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-416ed35d-7d95-4005-9d2a-3712521fb9d0 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:23.580733 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-416ed35d-7d95-4005-9d2a-3712521fb9d0 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:23.581333 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-416ed35d-7d95-4005-9d2a-3712521fb9d0 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:23.582124 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-416ed35d-7d95-4005-9d2a-3712521fb9d0 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:23.582559 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-416ed35d-7d95-4005-9d2a-3712521fb9d0 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:23.784241 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-416ed35d-7d95-4005-9d2a-3712521fb9d0 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:23.795698 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-416ed35d-7d95-4005-9d2a-3712521fb9d0 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.239220 Feb 20 20:05:23.796276 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 111/229] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:23 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:24.816471 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b440645c-76c6-4439-9061-d668c1e96464 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:24.817741 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b440645c-76c6-4439-9061-d668c1e96464 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:24.834465 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b440645c-76c6-4439-9061-d668c1e96464 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:24.835295 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b440645c-76c6-4439-9061-d668c1e96464 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:24.836669 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b440645c-76c6-4439-9061-d668c1e96464 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:24.838791 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b440645c-76c6-4439-9061-d668c1e96464 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:25.037626 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b440645c-76c6-4439-9061-d668c1e96464 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:25.045534 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b440645c-76c6-4439-9061-d668c1e96464 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.234801 Feb 20 20:05:25.046390 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 119/230] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:24 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:26.064603 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4402cdfd-b288-475e-8c8f-c50484fdd23b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:26.065423 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4402cdfd-b288-475e-8c8f-c50484fdd23b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:26.072666 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4402cdfd-b288-475e-8c8f-c50484fdd23b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:26.073240 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4402cdfd-b288-475e-8c8f-c50484fdd23b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:26.073986 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4402cdfd-b288-475e-8c8f-c50484fdd23b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:26.074765 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4402cdfd-b288-475e-8c8f-c50484fdd23b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:26.248255 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4402cdfd-b288-475e-8c8f-c50484fdd23b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:26.257716 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4402cdfd-b288-475e-8c8f-c50484fdd23b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.197509 Feb 20 20:05:26.258604 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 112/231] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:26 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:27.275953 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-739f78d7-29f7-4686-982a-0eff4202c7ea tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:27.276592 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-739f78d7-29f7-4686-982a-0eff4202c7ea tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:27.284207 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-739f78d7-29f7-4686-982a-0eff4202c7ea tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:27.284691 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-739f78d7-29f7-4686-982a-0eff4202c7ea tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:27.285526 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-739f78d7-29f7-4686-982a-0eff4202c7ea tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:27.285967 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-739f78d7-29f7-4686-982a-0eff4202c7ea tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:27.454614 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-739f78d7-29f7-4686-982a-0eff4202c7ea tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:27.459427 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-739f78d7-29f7-4686-982a-0eff4202c7ea tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.187061 Feb 20 20:05:27.460214 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 120/232] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:27 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:28.478085 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a2f5cdd5-5bf6-41a7-88e9-5d974de1dcbf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:28.478896 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a2f5cdd5-5bf6-41a7-88e9-5d974de1dcbf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:28.485314 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a2f5cdd5-5bf6-41a7-88e9-5d974de1dcbf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:28.485756 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a2f5cdd5-5bf6-41a7-88e9-5d974de1dcbf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:28.486540 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a2f5cdd5-5bf6-41a7-88e9-5d974de1dcbf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:28.486974 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a2f5cdd5-5bf6-41a7-88e9-5d974de1dcbf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:28.641927 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a2f5cdd5-5bf6-41a7-88e9-5d974de1dcbf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:28.650188 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a2f5cdd5-5bf6-41a7-88e9-5d974de1dcbf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.175728 Feb 20 20:05:28.650791 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 113/233] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:28 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:29.668631 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a161bbbe-fed3-4f10-8088-ae3834a14fd7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:29.670041 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a161bbbe-fed3-4f10-8088-ae3834a14fd7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:29.676687 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a161bbbe-fed3-4f10-8088-ae3834a14fd7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:29.679119 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a161bbbe-fed3-4f10-8088-ae3834a14fd7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:29.679119 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a161bbbe-fed3-4f10-8088-ae3834a14fd7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:29.679119 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a161bbbe-fed3-4f10-8088-ae3834a14fd7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:29.846522 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a161bbbe-fed3-4f10-8088-ae3834a14fd7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:29.861153 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a161bbbe-fed3-4f10-8088-ae3834a14fd7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.192077 Feb 20 20:05:29.861153 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 121/234] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:29 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:30.877749 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-24f9e82f-987c-4245-b2a0-6b3023c177d2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:30.878433 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-24f9e82f-987c-4245-b2a0-6b3023c177d2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:30.885444 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-24f9e82f-987c-4245-b2a0-6b3023c177d2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:30.886182 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-24f9e82f-987c-4245-b2a0-6b3023c177d2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:30.887566 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-24f9e82f-987c-4245-b2a0-6b3023c177d2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:30.887566 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-24f9e82f-987c-4245-b2a0-6b3023c177d2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:31.032512 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-24f9e82f-987c-4245-b2a0-6b3023c177d2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:31.039968 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-24f9e82f-987c-4245-b2a0-6b3023c177d2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.165979 Feb 20 20:05:31.040542 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 114/235] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:30 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:32.060113 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-221be987-c9df-43a8-bc56-93b7b9d63563 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:32.060773 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-221be987-c9df-43a8-bc56-93b7b9d63563 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:32.068537 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-221be987-c9df-43a8-bc56-93b7b9d63563 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:32.069073 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-221be987-c9df-43a8-bc56-93b7b9d63563 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:32.069951 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-221be987-c9df-43a8-bc56-93b7b9d63563 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:32.070387 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-221be987-c9df-43a8-bc56-93b7b9d63563 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:32.278230 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-221be987-c9df-43a8-bc56-93b7b9d63563 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:32.287290 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-221be987-c9df-43a8-bc56-93b7b9d63563 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.230638 Feb 20 20:05:32.287932 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 122/236] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:32 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:33.308348 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-817097d8-907e-4e89-9da2-6083a5d6040e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:33.311441 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-817097d8-907e-4e89-9da2-6083a5d6040e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:33.323622 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-817097d8-907e-4e89-9da2-6083a5d6040e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:33.324050 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-817097d8-907e-4e89-9da2-6083a5d6040e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:33.324787 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-817097d8-907e-4e89-9da2-6083a5d6040e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:33.325268 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-817097d8-907e-4e89-9da2-6083a5d6040e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:33.482758 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-817097d8-907e-4e89-9da2-6083a5d6040e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:33.491622 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-817097d8-907e-4e89-9da2-6083a5d6040e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.189036 Feb 20 20:05:33.497419 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 115/237] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:33 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:34.511178 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-aa29cd81-3593-4b01-9e90-dfff8915d7b2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:34.511807 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-aa29cd81-3593-4b01-9e90-dfff8915d7b2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:34.518501 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aa29cd81-3593-4b01-9e90-dfff8915d7b2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:34.519803 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aa29cd81-3593-4b01-9e90-dfff8915d7b2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:34.519803 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aa29cd81-3593-4b01-9e90-dfff8915d7b2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:34.520228 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aa29cd81-3593-4b01-9e90-dfff8915d7b2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:34.711293 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-aa29cd81-3593-4b01-9e90-dfff8915d7b2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:34.724071 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-aa29cd81-3593-4b01-9e90-dfff8915d7b2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.216122 Feb 20 20:05:34.734758 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 123/238] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:34 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:05:35.741734 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-97cb7d69-280c-4943-9b4a-67da2e93e853 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:35.742373 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-97cb7d69-280c-4943-9b4a-67da2e93e853 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:35.748545 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-97cb7d69-280c-4943-9b4a-67da2e93e853 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:35.749033 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-97cb7d69-280c-4943-9b4a-67da2e93e853 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:35.750285 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-97cb7d69-280c-4943-9b4a-67da2e93e853 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:35.750723 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-97cb7d69-280c-4943-9b4a-67da2e93e853 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:35.930283 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-97cb7d69-280c-4943-9b4a-67da2e93e853 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:35.938854 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-97cb7d69-280c-4943-9b4a-67da2e93e853 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1522 microversion: 2.1 time: 0.200348 Feb 20 20:05:35.939898 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 116/239] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:35 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:36.956420 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-242a0fff-feda-49af-b63c-510c5095ebe2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:36.957081 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-242a0fff-feda-49af-b63c-510c5095ebe2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:36.963939 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-242a0fff-feda-49af-b63c-510c5095ebe2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:36.964645 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-242a0fff-feda-49af-b63c-510c5095ebe2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:36.965481 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-242a0fff-feda-49af-b63c-510c5095ebe2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:36.965911 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-242a0fff-feda-49af-b63c-510c5095ebe2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:37.115524 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-242a0fff-feda-49af-b63c-510c5095ebe2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:37.123506 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-242a0fff-feda-49af-b63c-510c5095ebe2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1502 microversion: 2.1 time: 0.171664 Feb 20 20:05:37.135128 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 124/240] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:36 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1502 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:37.141391 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3c9582bb-bdb9-4bc8-8211-f0be493b53ae tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:37.142005 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3c9582bb-bdb9-4bc8-8211-f0be493b53ae tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:37.148226 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3c9582bb-bdb9-4bc8-8211-f0be493b53ae tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:37.148671 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3c9582bb-bdb9-4bc8-8211-f0be493b53ae tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:37.149872 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3c9582bb-bdb9-4bc8-8211-f0be493b53ae tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:37.150005 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3c9582bb-bdb9-4bc8-8211-f0be493b53ae tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:37.315574 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3c9582bb-bdb9-4bc8-8211-f0be493b53ae tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:37.322978 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3c9582bb-bdb9-4bc8-8211-f0be493b53ae tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1516 microversion: 2.1 time: 0.185284 Feb 20 20:05:37.323552 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 117/241] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:37 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1516 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:40.350763 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-47f7853a-ad45-4b65-a8b3-3c9aa864098b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:05:40.355136 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-47f7853a-ad45-4b65-a8b3-3c9aa864098b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:40.362865 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-47f7853a-ad45-4b65-a8b3-3c9aa864098b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:40.363609 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-47f7853a-ad45-4b65-a8b3-3c9aa864098b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:40.364621 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-47f7853a-ad45-4b65-a8b3-3c9aa864098b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:40.365235 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-47f7853a-ad45-4b65-a8b3-3c9aa864098b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:40.396847 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-47f7853a-ad45-4b65-a8b3-3c9aa864098b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lazy-loading 'flavor' on Instance uuid 6e394c2c-f9ca-4e79-9a43-f6a04f887f71 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:05:40.731836 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-47f7853a-ad45-4b65-a8b3-3c9aa864098b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "POST /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/action" status: 200 len: 32 microversion: 2.1 time: 0.386997 Feb 20 20:05:40.733341 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 125/242] 10.222.0.60 () {60 vars in 1277 bytes} [Sun Feb 20 20:05:40 2022] POST /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/action => generated 32 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 20 20:05:40.750373 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-eefa6641-b2ab-40d2-ab33-1df79f577df7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:40.765486 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-eefa6641-b2ab-40d2-ab33-1df79f577df7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:40.778479 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-eefa6641-b2ab-40d2-ab33-1df79f577df7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:40.779190 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-eefa6641-b2ab-40d2-ab33-1df79f577df7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:40.780342 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-eefa6641-b2ab-40d2-ab33-1df79f577df7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:40.781145 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-eefa6641-b2ab-40d2-ab33-1df79f577df7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:41.105725 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-eefa6641-b2ab-40d2-ab33-1df79f577df7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:41.116553 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-eefa6641-b2ab-40d2-ab33-1df79f577df7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.377100 Feb 20 20:05:41.118436 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 118/243] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:40 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:42.136504 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f780be22-8161-41c9-af78-084f609a97d9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:42.137944 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f780be22-8161-41c9-af78-084f609a97d9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:42.149480 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f780be22-8161-41c9-af78-084f609a97d9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:42.151537 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f780be22-8161-41c9-af78-084f609a97d9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:42.154971 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f780be22-8161-41c9-af78-084f609a97d9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:42.155871 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f780be22-8161-41c9-af78-084f609a97d9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:42.619248 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f780be22-8161-41c9-af78-084f609a97d9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:42.639999 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f780be22-8161-41c9-af78-084f609a97d9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.507672 Feb 20 20:05:42.640640 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 126/244] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:42 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:05:43.658819 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-145d3151-8a7e-43a0-ab21-b1f96d4f8e5f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:43.659942 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-145d3151-8a7e-43a0-ab21-b1f96d4f8e5f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:43.669113 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-145d3151-8a7e-43a0-ab21-b1f96d4f8e5f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:43.672579 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-145d3151-8a7e-43a0-ab21-b1f96d4f8e5f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:43.673431 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-145d3151-8a7e-43a0-ab21-b1f96d4f8e5f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:43.673871 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-145d3151-8a7e-43a0-ab21-b1f96d4f8e5f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:43.855881 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-145d3151-8a7e-43a0-ab21-b1f96d4f8e5f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:43.864731 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-145d3151-8a7e-43a0-ab21-b1f96d4f8e5f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.211043 Feb 20 20:05:43.865415 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 119/245] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:43 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:44.891082 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-05fbf76a-c307-41a4-8c8a-2752f1568ea5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:44.891702 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-05fbf76a-c307-41a4-8c8a-2752f1568ea5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:44.902991 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-05fbf76a-c307-41a4-8c8a-2752f1568ea5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:44.903439 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-05fbf76a-c307-41a4-8c8a-2752f1568ea5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:44.904242 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-05fbf76a-c307-41a4-8c8a-2752f1568ea5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:44.905621 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-05fbf76a-c307-41a4-8c8a-2752f1568ea5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:45.110017 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-05fbf76a-c307-41a4-8c8a-2752f1568ea5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:45.116463 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-05fbf76a-c307-41a4-8c8a-2752f1568ea5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.235463 Feb 20 20:05:45.117798 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 127/246] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:44 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:46.135989 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-09bce88f-0ded-49c7-8844-18bc736b8e8f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:46.138850 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-09bce88f-0ded-49c7-8844-18bc736b8e8f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:46.143471 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-09bce88f-0ded-49c7-8844-18bc736b8e8f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:46.144049 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-09bce88f-0ded-49c7-8844-18bc736b8e8f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:46.144933 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-09bce88f-0ded-49c7-8844-18bc736b8e8f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:46.145504 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-09bce88f-0ded-49c7-8844-18bc736b8e8f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:46.265357 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ca3da459-27c6-4464-8a5c-90bb014e1a23 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:05:46.265812 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ca3da459-27c6-4464-8a5c-90bb014e1a23 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:46.276241 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ca3da459-27c6-4464-8a5c-90bb014e1a23 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:46.276689 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ca3da459-27c6-4464-8a5c-90bb014e1a23 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:46.277508 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ca3da459-27c6-4464-8a5c-90bb014e1a23 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:46.284026 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ca3da459-27c6-4464-8a5c-90bb014e1a23 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:46.329161 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-ca3da459-27c6-4464-8a5c-90bb014e1a23 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lazy-loading 'flavor' on Instance uuid d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:05:46.329738 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-09bce88f-0ded-49c7-8844-18bc736b8e8f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:46.345524 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-09bce88f-0ded-49c7-8844-18bc736b8e8f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.213801 Feb 20 20:05:46.353031 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 120/247] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:46 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:46.940711 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ca3da459-27c6-4464-8a5c-90bb014e1a23 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "POST /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/action" status: 202 len: 0 microversion: 2.20 time: 0.679413 Feb 20 20:05:46.941337 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 128/248] 10.222.0.60 () {62 vars in 1318 bytes} [Sun Feb 20 20:05:46 2022] POST /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/action => generated 0 bytes in 681 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 20 20:05:46.951023 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-0b230838-8762-43b7-865c-4610fcd2c763 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:46.960831 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-0b230838-8762-43b7-865c-4610fcd2c763 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:46.971112 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0b230838-8762-43b7-865c-4610fcd2c763 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:46.971902 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0b230838-8762-43b7-865c-4610fcd2c763 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:46.972851 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0b230838-8762-43b7-865c-4610fcd2c763 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:46.974345 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0b230838-8762-43b7-865c-4610fcd2c763 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:47.228574 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0b230838-8762-43b7-865c-4610fcd2c763 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:47.238186 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0b230838-8762-43b7-865c-4610fcd2c763 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:47.239666 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0b230838-8762-43b7-865c-4610fcd2c763 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:47.241106 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-0b230838-8762-43b7-865c-4610fcd2c763 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.294922 Feb 20 20:05:47.242269 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 121/249] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:05:46 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:05:47.364086 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0b3321fc-7355-4c3e-b617-39a8415833be tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:47.364727 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-0b3321fc-7355-4c3e-b617-39a8415833be tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:47.371230 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0b3321fc-7355-4c3e-b617-39a8415833be tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:47.371684 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0b3321fc-7355-4c3e-b617-39a8415833be tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:47.372510 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0b3321fc-7355-4c3e-b617-39a8415833be tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:47.372958 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0b3321fc-7355-4c3e-b617-39a8415833be tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:47.526537 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0b3321fc-7355-4c3e-b617-39a8415833be tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:47.543883 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-0b3321fc-7355-4c3e-b617-39a8415833be tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.184043 Feb 20 20:05:47.546473 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 129/250] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:47 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:48.261747 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c5ef3a58-27ea-4dc7-b09b-c780ea29dc6c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:48.262357 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c5ef3a58-27ea-4dc7-b09b-c780ea29dc6c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:48.270223 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c5ef3a58-27ea-4dc7-b09b-c780ea29dc6c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:48.270672 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c5ef3a58-27ea-4dc7-b09b-c780ea29dc6c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:48.271464 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c5ef3a58-27ea-4dc7-b09b-c780ea29dc6c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:48.271898 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c5ef3a58-27ea-4dc7-b09b-c780ea29dc6c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:48.569554 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e3cee3a1-b24a-4d99-a982-8d6021694326 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:48.570733 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e3cee3a1-b24a-4d99-a982-8d6021694326 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:48.573673 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c5ef3a58-27ea-4dc7-b09b-c780ea29dc6c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:48.583398 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e3cee3a1-b24a-4d99-a982-8d6021694326 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:48.584551 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e3cee3a1-b24a-4d99-a982-8d6021694326 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:48.586205 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e3cee3a1-b24a-4d99-a982-8d6021694326 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:48.586866 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e3cee3a1-b24a-4d99-a982-8d6021694326 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:48.594465 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c5ef3a58-27ea-4dc7-b09b-c780ea29dc6c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:48.596080 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c5ef3a58-27ea-4dc7-b09b-c780ea29dc6c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:48.597388 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c5ef3a58-27ea-4dc7-b09b-c780ea29dc6c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.340741 Feb 20 20:05:48.598215 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 122/251] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:05:48 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:05:48.968187 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e3cee3a1-b24a-4d99-a982-8d6021694326 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:48.980819 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e3cee3a1-b24a-4d99-a982-8d6021694326 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.418020 Feb 20 20:05:48.982351 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 130/252] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:48 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:49.617198 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ed78c0e7-a75b-47c4-92a1-66cc8eb161ef tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:49.617805 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ed78c0e7-a75b-47c4-92a1-66cc8eb161ef tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:49.628645 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ed78c0e7-a75b-47c4-92a1-66cc8eb161ef tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:49.629608 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ed78c0e7-a75b-47c4-92a1-66cc8eb161ef tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:49.632087 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ed78c0e7-a75b-47c4-92a1-66cc8eb161ef tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:49.633626 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ed78c0e7-a75b-47c4-92a1-66cc8eb161ef tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:50.001477 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f7db63bf-ab4c-4a72-986d-28a201868b1f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:50.002420 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f7db63bf-ab4c-4a72-986d-28a201868b1f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:50.025224 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f7db63bf-ab4c-4a72-986d-28a201868b1f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:50.027463 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f7db63bf-ab4c-4a72-986d-28a201868b1f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:50.033668 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f7db63bf-ab4c-4a72-986d-28a201868b1f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:50.034362 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f7db63bf-ab4c-4a72-986d-28a201868b1f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:50.549345 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ed78c0e7-a75b-47c4-92a1-66cc8eb161ef tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:50.578587 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ed78c0e7-a75b-47c4-92a1-66cc8eb161ef tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:50.583228 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ed78c0e7-a75b-47c4-92a1-66cc8eb161ef tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:50.587311 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ed78c0e7-a75b-47c4-92a1-66cc8eb161ef tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.973981 Feb 20 20:05:50.591457 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 123/253] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:05:49 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:05:50.836142 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f7db63bf-ab4c-4a72-986d-28a201868b1f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:50.852676 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f7db63bf-ab4c-4a72-986d-28a201868b1f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.858101 Feb 20 20:05:50.853303 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 131/254] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:49 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:05:51.609986 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-cd7fe37e-3099-4a55-b70b-e555002a71ab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:51.610578 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-cd7fe37e-3099-4a55-b70b-e555002a71ab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:51.616928 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cd7fe37e-3099-4a55-b70b-e555002a71ab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:51.617394 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cd7fe37e-3099-4a55-b70b-e555002a71ab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:51.618436 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cd7fe37e-3099-4a55-b70b-e555002a71ab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:51.619070 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cd7fe37e-3099-4a55-b70b-e555002a71ab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:51.879781 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4ae25f6d-1060-4883-9976-ffad60f49a6d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:51.880895 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4ae25f6d-1060-4883-9976-ffad60f49a6d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:51.896351 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ae25f6d-1060-4883-9976-ffad60f49a6d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:51.897619 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ae25f6d-1060-4883-9976-ffad60f49a6d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:51.899708 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ae25f6d-1060-4883-9976-ffad60f49a6d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:51.900388 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ae25f6d-1060-4883-9976-ffad60f49a6d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:51.985198 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-cd7fe37e-3099-4a55-b70b-e555002a71ab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:51.997740 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-cd7fe37e-3099-4a55-b70b-e555002a71ab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:52.004793 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-cd7fe37e-3099-4a55-b70b-e555002a71ab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:52.007811 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-cd7fe37e-3099-4a55-b70b-e555002a71ab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.402438 Feb 20 20:05:52.009763 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 124/255] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:05:51 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:05:52.194593 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4ae25f6d-1060-4883-9976-ffad60f49a6d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:52.211007 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4ae25f6d-1060-4883-9976-ffad60f49a6d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.343103 Feb 20 20:05:52.211634 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 132/256] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:51 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:53.030885 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-186cbbb1-fd13-4b8d-8c99-038415450619 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:53.031561 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-186cbbb1-fd13-4b8d-8c99-038415450619 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:53.038859 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-186cbbb1-fd13-4b8d-8c99-038415450619 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:53.039324 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-186cbbb1-fd13-4b8d-8c99-038415450619 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:53.041423 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-186cbbb1-fd13-4b8d-8c99-038415450619 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:53.041865 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-186cbbb1-fd13-4b8d-8c99-038415450619 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:53.230708 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-06ef3eea-da13-426b-9fea-439fdb251847 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:53.231428 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-06ef3eea-da13-426b-9fea-439fdb251847 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:53.241661 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-06ef3eea-da13-426b-9fea-439fdb251847 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:53.248719 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-06ef3eea-da13-426b-9fea-439fdb251847 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:53.248719 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-06ef3eea-da13-426b-9fea-439fdb251847 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:53.248719 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-06ef3eea-da13-426b-9fea-439fdb251847 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:53.317382 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-186cbbb1-fd13-4b8d-8c99-038415450619 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:53.328875 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-186cbbb1-fd13-4b8d-8c99-038415450619 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:53.348489 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-186cbbb1-fd13-4b8d-8c99-038415450619 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:53.352253 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-186cbbb1-fd13-4b8d-8c99-038415450619 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.325180 Feb 20 20:05:53.353980 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 125/257] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:05:53 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:05:53.476029 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-06ef3eea-da13-426b-9fea-439fdb251847 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:53.490430 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-06ef3eea-da13-426b-9fea-439fdb251847 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.264183 Feb 20 20:05:53.492526 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 133/258] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:53 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:54.374207 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4790de56-b069-4ab7-82cf-5aa465a8ffa9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:54.375064 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4790de56-b069-4ab7-82cf-5aa465a8ffa9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:54.382620 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4790de56-b069-4ab7-82cf-5aa465a8ffa9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:54.383429 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4790de56-b069-4ab7-82cf-5aa465a8ffa9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:54.385356 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4790de56-b069-4ab7-82cf-5aa465a8ffa9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:54.386073 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4790de56-b069-4ab7-82cf-5aa465a8ffa9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:54.523071 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6c4a2857-4f84-4444-aab5-d56b119cc1d5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:54.525143 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6c4a2857-4f84-4444-aab5-d56b119cc1d5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:54.537680 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6c4a2857-4f84-4444-aab5-d56b119cc1d5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:54.538816 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6c4a2857-4f84-4444-aab5-d56b119cc1d5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:54.541667 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6c4a2857-4f84-4444-aab5-d56b119cc1d5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:54.543015 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6c4a2857-4f84-4444-aab5-d56b119cc1d5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:54.649832 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4790de56-b069-4ab7-82cf-5aa465a8ffa9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:54.664996 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4790de56-b069-4ab7-82cf-5aa465a8ffa9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:54.669727 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4790de56-b069-4ab7-82cf-5aa465a8ffa9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:54.672505 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4790de56-b069-4ab7-82cf-5aa465a8ffa9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.303771 Feb 20 20:05:54.673857 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 126/259] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:05:54 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:05:54.835576 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6c4a2857-4f84-4444-aab5-d56b119cc1d5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:54.872054 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6c4a2857-4f84-4444-aab5-d56b119cc1d5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.356146 Feb 20 20:05:54.873240 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 134/260] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:54 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:55.692314 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d9f8e242-7810-4522-81af-44cc1538407f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:55.693441 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d9f8e242-7810-4522-81af-44cc1538407f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:55.704774 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d9f8e242-7810-4522-81af-44cc1538407f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:55.705276 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d9f8e242-7810-4522-81af-44cc1538407f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:55.706085 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d9f8e242-7810-4522-81af-44cc1538407f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:55.706523 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d9f8e242-7810-4522-81af-44cc1538407f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:55.847920 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-febc8548-aab0-4fc3-82dc-b300463aa436 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Action: 'create', calling method: .version_select at 0x7fdd917ae0d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1960512012"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:05:55.870502 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-febc8548-aab0-4fc3-82dc-b300463aa436 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Getting quotas for project 2c8e34338e9a48629be67b295d115a7a. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:05:55.877931 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-febc8548-aab0-4fc3-82dc-b300463aa436 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Getting quotas for user 2dadec92c12145649a5381cd0fd4c462 and project 2c8e34338e9a48629be67b295d115a7a. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:05:55.896564 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d9f8e242-7810-4522-81af-44cc1538407f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:55.908451 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d9f8e242-7810-4522-81af-44cc1538407f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:55.909916 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d9f8e242-7810-4522-81af-44cc1538407f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:55.911117 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d9f8e242-7810-4522-81af-44cc1538407f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.222978 Feb 20 20:05:55.911698 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 135/261] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:05:55 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:05:55.916603 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0827bca7-cb1d-4f38-ae8d-63c3b813e326 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4dd7191-332c-4707-a7ee-535af5d52cc2"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:05:55.917739 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-0827bca7-cb1d-4f38-ae8d-63c3b813e326 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:55.926288 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0827bca7-cb1d-4f38-ae8d-63c3b813e326 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:55.926775 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0827bca7-cb1d-4f38-ae8d-63c3b813e326 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:55.927599 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0827bca7-cb1d-4f38-ae8d-63c3b813e326 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:55.928040 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0827bca7-cb1d-4f38-ae8d-63c3b813e326 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:56.167681 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-febc8548-aab0-4fc3-82dc-b300463aa436 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Getting quotas for project 2c8e34338e9a48629be67b295d115a7a. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:05:56.172074 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-febc8548-aab0-4fc3-82dc-b300463aa436 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Getting quotas for user 2dadec92c12145649a5381cd0fd4c462 and project 2c8e34338e9a48629be67b295d115a7a. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:05:56.190185 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-febc8548-aab0-4fc3-82dc-b300463aa436 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.620749 Feb 20 20:05:56.190941 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 127/262] 10.222.0.60 () {60 vars in 1157 bytes} [Sun Feb 20 20:05:55 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:56.195904 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e8dcd850-a88a-4e41-b745-7251abc99c3d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:56.196719 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e8dcd850-a88a-4e41-b745-7251abc99c3d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:56.210875 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e8dcd850-a88a-4e41-b745-7251abc99c3d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:56.217234 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e8dcd850-a88a-4e41-b745-7251abc99c3d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:56.217234 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e8dcd850-a88a-4e41-b745-7251abc99c3d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:56.217234 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e8dcd850-a88a-4e41-b745-7251abc99c3d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:56.439969 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e8dcd850-a88a-4e41-b745-7251abc99c3d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:56.449141 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e8dcd850-a88a-4e41-b745-7251abc99c3d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.256723 Feb 20 20:05:56.456675 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 128/263] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:56 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:05:56.932344 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a7cb7cf2-3be5-4b78-9768-41b8b7e5fd89 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:56.934196 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a7cb7cf2-3be5-4b78-9768-41b8b7e5fd89 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:56.946270 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a7cb7cf2-3be5-4b78-9768-41b8b7e5fd89 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:56.947090 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a7cb7cf2-3be5-4b78-9768-41b8b7e5fd89 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:56.948659 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a7cb7cf2-3be5-4b78-9768-41b8b7e5fd89 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:56.949498 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a7cb7cf2-3be5-4b78-9768-41b8b7e5fd89 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:57.144296 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a7cb7cf2-3be5-4b78-9768-41b8b7e5fd89 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:57.153638 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a7cb7cf2-3be5-4b78-9768-41b8b7e5fd89 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:57.156430 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a7cb7cf2-3be5-4b78-9768-41b8b7e5fd89 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:57.157698 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a7cb7cf2-3be5-4b78-9768-41b8b7e5fd89 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.229783 Feb 20 20:05:57.171679 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 129/264] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:05:56 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:05:57.467016 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-285c52d6-6b4d-4e91-9435-920a5774ff15 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:57.467945 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-285c52d6-6b4d-4e91-9435-920a5774ff15 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:57.475538 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-285c52d6-6b4d-4e91-9435-920a5774ff15 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:57.476351 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-285c52d6-6b4d-4e91-9435-920a5774ff15 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:57.477507 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-285c52d6-6b4d-4e91-9435-920a5774ff15 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:57.478106 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-285c52d6-6b4d-4e91-9435-920a5774ff15 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:57.685865 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-285c52d6-6b4d-4e91-9435-920a5774ff15 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:57.696725 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-285c52d6-6b4d-4e91-9435-920a5774ff15 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.233680 Feb 20 20:05:57.697370 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 130/265] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:57 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:05:58.176148 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ee63235e-ccbd-45cc-98d0-3cf886dae80b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:58.176996 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ee63235e-ccbd-45cc-98d0-3cf886dae80b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:58.182947 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ee63235e-ccbd-45cc-98d0-3cf886dae80b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:58.183469 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ee63235e-ccbd-45cc-98d0-3cf886dae80b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:58.184307 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ee63235e-ccbd-45cc-98d0-3cf886dae80b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:58.184883 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ee63235e-ccbd-45cc-98d0-3cf886dae80b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:58.351464 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ee63235e-ccbd-45cc-98d0-3cf886dae80b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:58.365769 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ee63235e-ccbd-45cc-98d0-3cf886dae80b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:58.367697 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ee63235e-ccbd-45cc-98d0-3cf886dae80b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:58.369915 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ee63235e-ccbd-45cc-98d0-3cf886dae80b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.197479 Feb 20 20:05:58.371069 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 131/266] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:05:58 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:05:58.720033 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a5ea2e00-2b36-4cc4-88d3-e8811b7c2499 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:58.720868 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a5ea2e00-2b36-4cc4-88d3-e8811b7c2499 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:58.728660 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a5ea2e00-2b36-4cc4-88d3-e8811b7c2499 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:58.729786 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a5ea2e00-2b36-4cc4-88d3-e8811b7c2499 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:58.730946 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a5ea2e00-2b36-4cc4-88d3-e8811b7c2499 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:58.731552 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a5ea2e00-2b36-4cc4-88d3-e8811b7c2499 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:59.004087 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a5ea2e00-2b36-4cc4-88d3-e8811b7c2499 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:59.013618 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a5ea2e00-2b36-4cc4-88d3-e8811b7c2499 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.301758 Feb 20 20:05:59.014851 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 132/267] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:05:58 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:05:59.390515 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6f289cc6-f14a-4518-8027-b23d394ac76e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:05:59.391216 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6f289cc6-f14a-4518-8027-b23d394ac76e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:05:59.396958 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-0827bca7-cb1d-4f38-ae8d-63c3b813e326 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "POST /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.483855 Feb 20 20:05:59.399752 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 136/268] 10.222.0.60 () {60 vars in 1322 bytes} [Sun Feb 20 20:05:55 2022] POST /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6/os-volume_attachments => generated 194 bytes in 3487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:05:59.427719 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6f289cc6-f14a-4518-8027-b23d394ac76e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:59.427719 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6f289cc6-f14a-4518-8027-b23d394ac76e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:59.433294 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6f289cc6-f14a-4518-8027-b23d394ac76e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:05:59.434160 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6f289cc6-f14a-4518-8027-b23d394ac76e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:05:59.713615 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6f289cc6-f14a-4518-8027-b23d394ac76e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:59.713615 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6f289cc6-f14a-4518-8027-b23d394ac76e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:59.714390 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6f289cc6-f14a-4518-8027-b23d394ac76e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:05:59.715575 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6f289cc6-f14a-4518-8027-b23d394ac76e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.330127 Feb 20 20:05:59.727921 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 133/269] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:05:59 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:06:00.037039 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-662a78c2-ff2a-4f83-aa34-b94728e4d726 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:00.038114 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-662a78c2-ff2a-4f83-aa34-b94728e4d726 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:00.048932 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-662a78c2-ff2a-4f83-aa34-b94728e4d726 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:00.049696 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-662a78c2-ff2a-4f83-aa34-b94728e4d726 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:00.050489 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-662a78c2-ff2a-4f83-aa34-b94728e4d726 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:00.050911 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-662a78c2-ff2a-4f83-aa34-b94728e4d726 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:00.258155 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-662a78c2-ff2a-4f83-aa34-b94728e4d726 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:00.258155 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-662a78c2-ff2a-4f83-aa34-b94728e4d726 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.215600 Feb 20 20:06:00.258155 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 137/270] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:00 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:00.740222 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-05331fd5-0f54-40e5-97ec-d5d5531418d1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:00.740222 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-05331fd5-0f54-40e5-97ec-d5d5531418d1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:00.747412 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-05331fd5-0f54-40e5-97ec-d5d5531418d1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:00.748205 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-05331fd5-0f54-40e5-97ec-d5d5531418d1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:00.749646 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-05331fd5-0f54-40e5-97ec-d5d5531418d1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:00.750374 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-05331fd5-0f54-40e5-97ec-d5d5531418d1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:00.993842 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-05331fd5-0f54-40e5-97ec-d5d5531418d1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:01.008952 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-05331fd5-0f54-40e5-97ec-d5d5531418d1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:01.018140 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-05331fd5-0f54-40e5-97ec-d5d5531418d1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:01.018140 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-05331fd5-0f54-40e5-97ec-d5d5531418d1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.282406 Feb 20 20:06:01.018140 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 134/271] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:00 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:01.280013 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-31669600-ca85-462b-adf8-37b4e30bc425 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:01.282011 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-31669600-ca85-462b-adf8-37b4e30bc425 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:01.289447 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-31669600-ca85-462b-adf8-37b4e30bc425 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:01.293430 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-31669600-ca85-462b-adf8-37b4e30bc425 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:01.293430 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-31669600-ca85-462b-adf8-37b4e30bc425 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:01.293430 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-31669600-ca85-462b-adf8-37b4e30bc425 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:01.476066 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-31669600-ca85-462b-adf8-37b4e30bc425 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:01.484909 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-31669600-ca85-462b-adf8-37b4e30bc425 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.209565 Feb 20 20:06:01.490358 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 138/272] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:01 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:02.034041 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-93a5b93d-72fe-4e44-b599-681c64db0139 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:02.034779 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-93a5b93d-72fe-4e44-b599-681c64db0139 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:02.040733 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-93a5b93d-72fe-4e44-b599-681c64db0139 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:02.041392 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-93a5b93d-72fe-4e44-b599-681c64db0139 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:02.042277 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-93a5b93d-72fe-4e44-b599-681c64db0139 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:02.042710 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-93a5b93d-72fe-4e44-b599-681c64db0139 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:02.218273 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-93a5b93d-72fe-4e44-b599-681c64db0139 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:02.227054 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-93a5b93d-72fe-4e44-b599-681c64db0139 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:02.230547 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-93a5b93d-72fe-4e44-b599-681c64db0139 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:02.230547 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-93a5b93d-72fe-4e44-b599-681c64db0139 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.199375 Feb 20 20:06:02.230547 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 135/273] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:02 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:02.509451 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9da1a6a0-be3b-4cb7-85a9-f58d4bc0133d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:02.510179 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9da1a6a0-be3b-4cb7-85a9-f58d4bc0133d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:02.518764 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9da1a6a0-be3b-4cb7-85a9-f58d4bc0133d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:02.519216 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9da1a6a0-be3b-4cb7-85a9-f58d4bc0133d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:02.520014 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9da1a6a0-be3b-4cb7-85a9-f58d4bc0133d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:02.520451 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9da1a6a0-be3b-4cb7-85a9-f58d4bc0133d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:02.716021 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9da1a6a0-be3b-4cb7-85a9-f58d4bc0133d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:02.724449 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9da1a6a0-be3b-4cb7-85a9-f58d4bc0133d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.221535 Feb 20 20:06:02.725044 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 139/274] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:02 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:03.247982 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3026f3d4-420c-44a2-a3d6-25e5e2e7c4b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:03.248812 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3026f3d4-420c-44a2-a3d6-25e5e2e7c4b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:03.254983 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3026f3d4-420c-44a2-a3d6-25e5e2e7c4b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:03.255435 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3026f3d4-420c-44a2-a3d6-25e5e2e7c4b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:03.256221 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3026f3d4-420c-44a2-a3d6-25e5e2e7c4b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:03.256656 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3026f3d4-420c-44a2-a3d6-25e5e2e7c4b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:03.398109 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3026f3d4-420c-44a2-a3d6-25e5e2e7c4b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:03.406265 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3026f3d4-420c-44a2-a3d6-25e5e2e7c4b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:03.407783 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3026f3d4-420c-44a2-a3d6-25e5e2e7c4b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:03.409147 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3026f3d4-420c-44a2-a3d6-25e5e2e7c4b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.165122 Feb 20 20:06:03.409714 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 136/275] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:03 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:03.742803 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9a203268-f031-4a3d-bb31-c3386ffc94d4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:03.743459 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9a203268-f031-4a3d-bb31-c3386ffc94d4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:03.751097 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9a203268-f031-4a3d-bb31-c3386ffc94d4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:03.751653 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9a203268-f031-4a3d-bb31-c3386ffc94d4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:03.752538 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9a203268-f031-4a3d-bb31-c3386ffc94d4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:03.753031 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9a203268-f031-4a3d-bb31-c3386ffc94d4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:03.923376 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9a203268-f031-4a3d-bb31-c3386ffc94d4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:03.933640 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9a203268-f031-4a3d-bb31-c3386ffc94d4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.194340 Feb 20 20:06:03.934344 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 140/276] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:03 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:04.427333 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a6a851af-62b3-441c-8786-52c82fc20cbf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:04.428560 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a6a851af-62b3-441c-8786-52c82fc20cbf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:04.434221 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a6a851af-62b3-441c-8786-52c82fc20cbf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:04.434662 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a6a851af-62b3-441c-8786-52c82fc20cbf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:04.436677 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a6a851af-62b3-441c-8786-52c82fc20cbf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:04.436677 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a6a851af-62b3-441c-8786-52c82fc20cbf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:04.587748 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a6a851af-62b3-441c-8786-52c82fc20cbf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:04.597005 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a6a851af-62b3-441c-8786-52c82fc20cbf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:04.598778 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a6a851af-62b3-441c-8786-52c82fc20cbf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:04.600032 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a6a851af-62b3-441c-8786-52c82fc20cbf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.176483 Feb 20 20:06:04.600688 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 137/277] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:04 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:04.951235 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-29868d3f-80ce-470a-a364-67e5b28175d1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:04.952459 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-29868d3f-80ce-470a-a364-67e5b28175d1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:04.958865 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-29868d3f-80ce-470a-a364-67e5b28175d1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:04.959323 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-29868d3f-80ce-470a-a364-67e5b28175d1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:04.960111 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-29868d3f-80ce-470a-a364-67e5b28175d1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:04.960547 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-29868d3f-80ce-470a-a364-67e5b28175d1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:05.109624 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-29868d3f-80ce-470a-a364-67e5b28175d1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:05.117336 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-29868d3f-80ce-470a-a364-67e5b28175d1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.169686 Feb 20 20:06:05.117910 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 141/278] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:04 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:05.618396 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-145ad239-92f6-4557-8680-0c3554316c9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:05.619026 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-145ad239-92f6-4557-8680-0c3554316c9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:05.626605 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-145ad239-92f6-4557-8680-0c3554316c9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:05.630293 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-145ad239-92f6-4557-8680-0c3554316c9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:05.630293 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-145ad239-92f6-4557-8680-0c3554316c9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:05.630293 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-145ad239-92f6-4557-8680-0c3554316c9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:05.787378 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-145ad239-92f6-4557-8680-0c3554316c9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:05.797428 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-145ad239-92f6-4557-8680-0c3554316c9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:05.798686 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-145ad239-92f6-4557-8680-0c3554316c9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:05.800152 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-145ad239-92f6-4557-8680-0c3554316c9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.185415 Feb 20 20:06:05.800737 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 138/279] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:05 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:06.135225 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-147fa491-53b0-4648-9d4f-e8d1b548980a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:06.135916 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-147fa491-53b0-4648-9d4f-e8d1b548980a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:06.143572 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-147fa491-53b0-4648-9d4f-e8d1b548980a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:06.144368 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-147fa491-53b0-4648-9d4f-e8d1b548980a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:06.144902 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-147fa491-53b0-4648-9d4f-e8d1b548980a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:06.145403 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-147fa491-53b0-4648-9d4f-e8d1b548980a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:06.353866 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-147fa491-53b0-4648-9d4f-e8d1b548980a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:06.363348 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-147fa491-53b0-4648-9d4f-e8d1b548980a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.231852 Feb 20 20:06:06.364962 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 142/280] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:06 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:06.819340 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-06a18a4c-38b6-4330-ae2b-a78cb199abe8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:06.820029 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-06a18a4c-38b6-4330-ae2b-a78cb199abe8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:06.827767 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-06a18a4c-38b6-4330-ae2b-a78cb199abe8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:06.828383 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-06a18a4c-38b6-4330-ae2b-a78cb199abe8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:06.829014 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-06a18a4c-38b6-4330-ae2b-a78cb199abe8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:06.829555 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-06a18a4c-38b6-4330-ae2b-a78cb199abe8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:07.016042 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-06a18a4c-38b6-4330-ae2b-a78cb199abe8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:07.024835 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-06a18a4c-38b6-4330-ae2b-a78cb199abe8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:07.026388 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-06a18a4c-38b6-4330-ae2b-a78cb199abe8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:07.027561 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-06a18a4c-38b6-4330-ae2b-a78cb199abe8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.212131 Feb 20 20:06:07.028125 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 139/281] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:06 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:07.387686 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d5661682-b2af-42ad-a3ef-14bada41b84b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:07.389626 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d5661682-b2af-42ad-a3ef-14bada41b84b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:07.411637 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d5661682-b2af-42ad-a3ef-14bada41b84b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:07.412167 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d5661682-b2af-42ad-a3ef-14bada41b84b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:07.413756 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d5661682-b2af-42ad-a3ef-14bada41b84b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:07.414461 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d5661682-b2af-42ad-a3ef-14bada41b84b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:07.585556 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d5661682-b2af-42ad-a3ef-14bada41b84b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:07.594288 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d5661682-b2af-42ad-a3ef-14bada41b84b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.213336 Feb 20 20:06:07.594878 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 143/282] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:07 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:08.056070 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-08068f1d-a4ad-47c2-9066-1f867cfa5c9b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:08.056711 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-08068f1d-a4ad-47c2-9066-1f867cfa5c9b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:08.063376 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-08068f1d-a4ad-47c2-9066-1f867cfa5c9b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:08.064136 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-08068f1d-a4ad-47c2-9066-1f867cfa5c9b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:08.065167 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-08068f1d-a4ad-47c2-9066-1f867cfa5c9b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:08.065614 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-08068f1d-a4ad-47c2-9066-1f867cfa5c9b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:08.234737 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-08068f1d-a4ad-47c2-9066-1f867cfa5c9b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:08.245134 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-08068f1d-a4ad-47c2-9066-1f867cfa5c9b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:08.246541 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-08068f1d-a4ad-47c2-9066-1f867cfa5c9b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:08.247718 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-08068f1d-a4ad-47c2-9066-1f867cfa5c9b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.196010 Feb 20 20:06:08.248593 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 140/283] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:08 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:08.617419 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bd56162b-8335-438d-9828-c09689184d96 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:08.618554 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-bd56162b-8335-438d-9828-c09689184d96 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:08.629352 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bd56162b-8335-438d-9828-c09689184d96 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:08.629932 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bd56162b-8335-438d-9828-c09689184d96 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:08.631135 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bd56162b-8335-438d-9828-c09689184d96 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:08.631773 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bd56162b-8335-438d-9828-c09689184d96 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:08.821511 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-bd56162b-8335-438d-9828-c09689184d96 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:08.829872 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-bd56162b-8335-438d-9828-c09689184d96 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1502 microversion: 2.1 time: 0.219422 Feb 20 20:06:08.830463 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 144/284] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:08 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1502 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:08.848682 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e412b7bb-8d1e-4caa-9e27-4bb87a19ae35 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc4bb231-8ce3-4d3a-8f96-23856693ebf8"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:06:08.849925 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e412b7bb-8d1e-4caa-9e27-4bb87a19ae35 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:08.858155 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e412b7bb-8d1e-4caa-9e27-4bb87a19ae35 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:08.858625 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e412b7bb-8d1e-4caa-9e27-4bb87a19ae35 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:08.859464 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e412b7bb-8d1e-4caa-9e27-4bb87a19ae35 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:08.859898 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e412b7bb-8d1e-4caa-9e27-4bb87a19ae35 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:08.889322 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-e412b7bb-8d1e-4caa-9e27-4bb87a19ae35 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] HTTP exception thrown: Cannot 'attach_volume' instance 6e394c2c-f9ca-4e79-9a43-f6a04f887f71 while it is in vm_state rescued Feb 20 20:06:08.890105 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e412b7bb-8d1e-4caa-9e27-4bb87a19ae35 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Returning 409 to user: Cannot 'attach_volume' instance 6e394c2c-f9ca-4e79-9a43-f6a04f887f71 while it is in vm_state rescued {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:06:08.890943 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e412b7bb-8d1e-4caa-9e27-4bb87a19ae35 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "POST /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046418 Feb 20 20:06:08.891507 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 141/285] 10.222.0.60 () {60 vars in 1322 bytes} [Sun Feb 20 20:06:08 2022] POST /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Feb 20 20:06:08.903545 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-284415da-050c-451c-b9a1-bf8b5604bbbe tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:06:08.905005 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-284415da-050c-451c-b9a1-bf8b5604bbbe tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:08.914177 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-284415da-050c-451c-b9a1-bf8b5604bbbe tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:08.914892 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-284415da-050c-451c-b9a1-bf8b5604bbbe tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:08.916146 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-284415da-050c-451c-b9a1-bf8b5604bbbe tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:08.916826 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-284415da-050c-451c-b9a1-bf8b5604bbbe tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:09.204646 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-284415da-050c-451c-b9a1-bf8b5604bbbe tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "POST /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/action" status: 202 len: 0 microversion: 2.1 time: 0.307415 Feb 20 20:06:09.205395 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 145/286] 10.222.0.60 () {60 vars in 1277 bytes} [Sun Feb 20 20:06:08 2022] POST /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:06:09.225558 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ec40d0bc-51e0-4508-8637-87a8bff4a580 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:09.226715 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ec40d0bc-51e0-4508-8637-87a8bff4a580 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:09.235099 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ec40d0bc-51e0-4508-8637-87a8bff4a580 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:09.235553 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ec40d0bc-51e0-4508-8637-87a8bff4a580 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:09.236390 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ec40d0bc-51e0-4508-8637-87a8bff4a580 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:09.236827 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ec40d0bc-51e0-4508-8637-87a8bff4a580 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:09.270648 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c814db68-4dc0-4d9a-ba54-7e761a239d19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:09.271258 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c814db68-4dc0-4d9a-ba54-7e761a239d19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:09.277758 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c814db68-4dc0-4d9a-ba54-7e761a239d19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:09.278212 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c814db68-4dc0-4d9a-ba54-7e761a239d19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:09.279008 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c814db68-4dc0-4d9a-ba54-7e761a239d19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:09.280838 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c814db68-4dc0-4d9a-ba54-7e761a239d19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:09.487443 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ec40d0bc-51e0-4508-8637-87a8bff4a580 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:09.501890 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ec40d0bc-51e0-4508-8637-87a8bff4a580 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1510 microversion: 2.1 time: 0.282918 Feb 20 20:06:09.513294 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 142/287] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:09 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1510 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:09.550836 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c814db68-4dc0-4d9a-ba54-7e761a239d19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:09.561948 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c814db68-4dc0-4d9a-ba54-7e761a239d19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:09.564250 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c814db68-4dc0-4d9a-ba54-7e761a239d19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:09.565572 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c814db68-4dc0-4d9a-ba54-7e761a239d19 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.299135 Feb 20 20:06:09.566199 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 146/288] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:09 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:10.521344 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3fcdff7b-b5ae-4f59-8899-7320db98a740 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:10.522156 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3fcdff7b-b5ae-4f59-8899-7320db98a740 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:10.528733 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3fcdff7b-b5ae-4f59-8899-7320db98a740 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:10.529997 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3fcdff7b-b5ae-4f59-8899-7320db98a740 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:10.531013 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3fcdff7b-b5ae-4f59-8899-7320db98a740 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:10.531452 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3fcdff7b-b5ae-4f59-8899-7320db98a740 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:10.585140 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-92cd27e3-ff97-4ea5-8539-d2c62c482018 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:10.586882 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-92cd27e3-ff97-4ea5-8539-d2c62c482018 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:10.596793 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-92cd27e3-ff97-4ea5-8539-d2c62c482018 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:10.603256 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-92cd27e3-ff97-4ea5-8539-d2c62c482018 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:10.605632 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-92cd27e3-ff97-4ea5-8539-d2c62c482018 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:10.606090 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-92cd27e3-ff97-4ea5-8539-d2c62c482018 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:10.730693 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3fcdff7b-b5ae-4f59-8899-7320db98a740 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:10.744241 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3fcdff7b-b5ae-4f59-8899-7320db98a740 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1510 microversion: 2.1 time: 0.226496 Feb 20 20:06:10.745246 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 143/289] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:10 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:10.798397 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-92cd27e3-ff97-4ea5-8539-d2c62c482018 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:10.806850 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-92cd27e3-ff97-4ea5-8539-d2c62c482018 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:10.808392 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-92cd27e3-ff97-4ea5-8539-d2c62c482018 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:10.809607 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-92cd27e3-ff97-4ea5-8539-d2c62c482018 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.228919 Feb 20 20:06:10.810173 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 147/290] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:10 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:06:11.762286 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-654952c2-d3de-4c9d-8489-bbbc444a56f8 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:11.762892 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-654952c2-d3de-4c9d-8489-bbbc444a56f8 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:11.769600 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-654952c2-d3de-4c9d-8489-bbbc444a56f8 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:11.770051 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-654952c2-d3de-4c9d-8489-bbbc444a56f8 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:11.770830 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-654952c2-d3de-4c9d-8489-bbbc444a56f8 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:11.771264 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-654952c2-d3de-4c9d-8489-bbbc444a56f8 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:11.828907 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c3f4f655-d1f4-4031-aac1-ce6ffa2789e5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:11.829697 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c3f4f655-d1f4-4031-aac1-ce6ffa2789e5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:11.836303 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c3f4f655-d1f4-4031-aac1-ce6ffa2789e5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:11.836824 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c3f4f655-d1f4-4031-aac1-ce6ffa2789e5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:11.837572 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c3f4f655-d1f4-4031-aac1-ce6ffa2789e5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:11.838011 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c3f4f655-d1f4-4031-aac1-ce6ffa2789e5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:11.954312 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-654952c2-d3de-4c9d-8489-bbbc444a56f8 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:11.961622 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-654952c2-d3de-4c9d-8489-bbbc444a56f8 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1510 microversion: 2.1 time: 0.202871 Feb 20 20:06:11.962197 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 144/291] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:11 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1510 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:12.022169 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c3f4f655-d1f4-4031-aac1-ce6ffa2789e5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:12.029844 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c3f4f655-d1f4-4031-aac1-ce6ffa2789e5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:12.031328 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c3f4f655-d1f4-4031-aac1-ce6ffa2789e5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:12.032459 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c3f4f655-d1f4-4031-aac1-ce6ffa2789e5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.208057 Feb 20 20:06:12.033011 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 148/292] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:11 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:06:12.978899 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-bf91d46f-c59a-49d1-9ace-3a51c2f21cf2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:12.979507 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-bf91d46f-c59a-49d1-9ace-3a51c2f21cf2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:12.986026 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bf91d46f-c59a-49d1-9ace-3a51c2f21cf2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:12.986477 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bf91d46f-c59a-49d1-9ace-3a51c2f21cf2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:12.987272 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bf91d46f-c59a-49d1-9ace-3a51c2f21cf2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:12.987710 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bf91d46f-c59a-49d1-9ace-3a51c2f21cf2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:13.049992 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-324da29d-f9c4-44e9-bbef-480a396767b9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:13.050699 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-324da29d-f9c4-44e9-bbef-480a396767b9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:13.057361 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-324da29d-f9c4-44e9-bbef-480a396767b9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:13.057807 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-324da29d-f9c4-44e9-bbef-480a396767b9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:13.058588 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-324da29d-f9c4-44e9-bbef-480a396767b9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:13.059021 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-324da29d-f9c4-44e9-bbef-480a396767b9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:13.163876 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-bf91d46f-c59a-49d1-9ace-3a51c2f21cf2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:13.175663 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-bf91d46f-c59a-49d1-9ace-3a51c2f21cf2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1510 microversion: 2.1 time: 0.200354 Feb 20 20:06:13.176266 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 145/293] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:12 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1510 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:13.230776 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-324da29d-f9c4-44e9-bbef-480a396767b9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:13.239553 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-324da29d-f9c4-44e9-bbef-480a396767b9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:13.241043 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-324da29d-f9c4-44e9-bbef-480a396767b9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:13.242220 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-324da29d-f9c4-44e9-bbef-480a396767b9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.196047 Feb 20 20:06:13.242776 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 149/294] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:13 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:06:14.192683 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2ec96ec2-ddd0-477a-a8a6-790a74973641 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:14.193333 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2ec96ec2-ddd0-477a-a8a6-790a74973641 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:14.199383 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ec96ec2-ddd0-477a-a8a6-790a74973641 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:14.199826 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ec96ec2-ddd0-477a-a8a6-790a74973641 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:14.200614 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ec96ec2-ddd0-477a-a8a6-790a74973641 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:14.201167 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ec96ec2-ddd0-477a-a8a6-790a74973641 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:14.260694 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-533eb8c2-833a-444e-9461-711b9757cb65 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:14.261526 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-533eb8c2-833a-444e-9461-711b9757cb65 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:14.269709 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-533eb8c2-833a-444e-9461-711b9757cb65 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:14.270159 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-533eb8c2-833a-444e-9461-711b9757cb65 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:14.272222 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-533eb8c2-833a-444e-9461-711b9757cb65 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:14.272222 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-533eb8c2-833a-444e-9461-711b9757cb65 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:14.380779 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2ec96ec2-ddd0-477a-a8a6-790a74973641 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:14.388571 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2ec96ec2-ddd0-477a-a8a6-790a74973641 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1510 microversion: 2.1 time: 0.199628 Feb 20 20:06:14.399361 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 146/295] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:14 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1510 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:14.452179 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-533eb8c2-833a-444e-9461-711b9757cb65 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:14.460222 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-533eb8c2-833a-444e-9461-711b9757cb65 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:14.461790 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-533eb8c2-833a-444e-9461-711b9757cb65 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:14.462943 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-533eb8c2-833a-444e-9461-711b9757cb65 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.206019 Feb 20 20:06:14.463503 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 150/296] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:14 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:06:15.150949 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-18eb9933-df9a-4109-b722-93fb066f77cd tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:06:15.158065 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-18eb9933-df9a-4109-b722-93fb066f77cd tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:15.158528 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-18eb9933-df9a-4109-b722-93fb066f77cd tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:15.225121 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-18eb9933-df9a-4109-b722-93fb066f77cd tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Going to try to stop instance {{(pid=117087) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 20 20:06:15.406351 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ae34b16c-4793-4a26-b7fc-5a0acf32da33 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:15.407091 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ae34b16c-4793-4a26-b7fc-5a0acf32da33 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:15.413567 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ae34b16c-4793-4a26-b7fc-5a0acf32da33 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:15.416229 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ae34b16c-4793-4a26-b7fc-5a0acf32da33 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:15.416229 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ae34b16c-4793-4a26-b7fc-5a0acf32da33 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:15.416229 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ae34b16c-4793-4a26-b7fc-5a0acf32da33 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:15.438040 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-18eb9933-df9a-4109-b722-93fb066f77cd tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "POST /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6/action" status: 202 len: 0 microversion: 2.1 time: 0.290661 Feb 20 20:06:15.438793 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 147/297] 10.222.0.60 () {60 vars in 1277 bytes} [Sun Feb 20 20:06:15 2022] POST /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:06:15.447110 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-dd1eb772-d4d8-474e-a767-910e057318ed tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:15.447990 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-dd1eb772-d4d8-474e-a767-910e057318ed tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:15.454876 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dd1eb772-d4d8-474e-a767-910e057318ed tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:15.455315 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dd1eb772-d4d8-474e-a767-910e057318ed tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:15.456089 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dd1eb772-d4d8-474e-a767-910e057318ed tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:15.456550 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dd1eb772-d4d8-474e-a767-910e057318ed tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:15.637110 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ae34b16c-4793-4a26-b7fc-5a0acf32da33 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:15.648319 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ae34b16c-4793-4a26-b7fc-5a0acf32da33 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1510 microversion: 2.1 time: 0.245779 Feb 20 20:06:15.649026 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 151/298] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:15 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1510 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:15.654649 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-513d5264-588c-4447-9f99-56be987990af tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:15.655651 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-513d5264-588c-4447-9f99-56be987990af tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:15.665313 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-513d5264-588c-4447-9f99-56be987990af tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:15.665313 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-513d5264-588c-4447-9f99-56be987990af tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:15.665313 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-513d5264-588c-4447-9f99-56be987990af tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:15.665313 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-513d5264-588c-4447-9f99-56be987990af tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:15.694355 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-dd1eb772-d4d8-474e-a767-910e057318ed tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:15.705931 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-dd1eb772-d4d8-474e-a767-910e057318ed tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1721 microversion: 2.1 time: 0.262635 Feb 20 20:06:15.706562 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 148/299] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:15 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1721 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:15.829507 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-513d5264-588c-4447-9f99-56be987990af tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:15.838198 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-513d5264-588c-4447-9f99-56be987990af tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:15.839984 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-513d5264-588c-4447-9f99-56be987990af tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:15.841188 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-513d5264-588c-4447-9f99-56be987990af tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1747 microversion: 2.20 time: 0.191153 Feb 20 20:06:15.841976 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 152/300] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:15 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1747 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:16.674303 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4759991b-7f5e-4a28-9d70-31feeebf136e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:16.674995 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4759991b-7f5e-4a28-9d70-31feeebf136e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:16.681380 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4759991b-7f5e-4a28-9d70-31feeebf136e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:16.681834 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4759991b-7f5e-4a28-9d70-31feeebf136e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:16.682616 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4759991b-7f5e-4a28-9d70-31feeebf136e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:16.683051 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4759991b-7f5e-4a28-9d70-31feeebf136e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:16.728903 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6d1c6d5d-996f-4e37-8f9d-5224807f3220 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:16.729577 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6d1c6d5d-996f-4e37-8f9d-5224807f3220 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:16.736504 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6d1c6d5d-996f-4e37-8f9d-5224807f3220 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:16.736994 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6d1c6d5d-996f-4e37-8f9d-5224807f3220 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:16.737819 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6d1c6d5d-996f-4e37-8f9d-5224807f3220 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:16.738325 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6d1c6d5d-996f-4e37-8f9d-5224807f3220 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:16.889919 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4759991b-7f5e-4a28-9d70-31feeebf136e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:16.900202 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4759991b-7f5e-4a28-9d70-31feeebf136e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1516 microversion: 2.1 time: 0.227896 Feb 20 20:06:16.900895 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 149/301] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:16 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:16.905658 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b0a49a39-a409-4435-9508-4f509b02de0f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:16.906310 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b0a49a39-a409-4435-9508-4f509b02de0f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:16.916271 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b0a49a39-a409-4435-9508-4f509b02de0f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:16.916271 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b0a49a39-a409-4435-9508-4f509b02de0f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:16.916271 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b0a49a39-a409-4435-9508-4f509b02de0f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:16.916271 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b0a49a39-a409-4435-9508-4f509b02de0f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:16.951611 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6d1c6d5d-996f-4e37-8f9d-5224807f3220 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:16.964112 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6d1c6d5d-996f-4e37-8f9d-5224807f3220 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1721 microversion: 2.1 time: 0.238893 Feb 20 20:06:16.965059 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 153/302] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:16 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:17.132389 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b0a49a39-a409-4435-9508-4f509b02de0f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:17.141496 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b0a49a39-a409-4435-9508-4f509b02de0f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:17.143031 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b0a49a39-a409-4435-9508-4f509b02de0f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:17.144249 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b0a49a39-a409-4435-9508-4f509b02de0f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1747 microversion: 2.20 time: 0.242344 Feb 20 20:06:17.144778 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 150/303] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:16 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1747 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:17.989296 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b040f02f-2749-4461-88fb-0adefc591f4c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:17.990006 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b040f02f-2749-4461-88fb-0adefc591f4c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:17.996522 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b040f02f-2749-4461-88fb-0adefc591f4c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:17.996916 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b040f02f-2749-4461-88fb-0adefc591f4c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:17.997821 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b040f02f-2749-4461-88fb-0adefc591f4c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:17.999122 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b040f02f-2749-4461-88fb-0adefc591f4c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:18.148812 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b040f02f-2749-4461-88fb-0adefc591f4c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:18.158828 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b040f02f-2749-4461-88fb-0adefc591f4c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1721 microversion: 2.1 time: 0.173289 Feb 20 20:06:18.159449 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 154/304] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:17 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:18.163150 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-aada9033-ba28-4f0c-9f0b-01f8ad32c6ae tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:18.163774 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-aada9033-ba28-4f0c-9f0b-01f8ad32c6ae tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:18.169734 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-aada9033-ba28-4f0c-9f0b-01f8ad32c6ae tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:18.170203 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-aada9033-ba28-4f0c-9f0b-01f8ad32c6ae tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:18.171182 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-aada9033-ba28-4f0c-9f0b-01f8ad32c6ae tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:18.171650 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-aada9033-ba28-4f0c-9f0b-01f8ad32c6ae tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:18.322224 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-aada9033-ba28-4f0c-9f0b-01f8ad32c6ae tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:18.332988 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-aada9033-ba28-4f0c-9f0b-01f8ad32c6ae tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:18.334532 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-aada9033-ba28-4f0c-9f0b-01f8ad32c6ae tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:18.335739 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-aada9033-ba28-4f0c-9f0b-01f8ad32c6ae tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1742 microversion: 2.20 time: 0.176368 Feb 20 20:06:18.336302 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 151/305] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:18 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1742 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:06:18.823672 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-41459fc8-a043-4c4b-9a77-ebd7df2bfc5a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:18.824292 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-41459fc8-a043-4c4b-9a77-ebd7df2bfc5a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:18.831154 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-41459fc8-a043-4c4b-9a77-ebd7df2bfc5a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:18.831601 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-41459fc8-a043-4c4b-9a77-ebd7df2bfc5a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:18.833402 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-41459fc8-a043-4c4b-9a77-ebd7df2bfc5a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:18.834202 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-41459fc8-a043-4c4b-9a77-ebd7df2bfc5a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:19.062464 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-41459fc8-a043-4c4b-9a77-ebd7df2bfc5a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:19.072668 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-41459fc8-a043-4c4b-9a77-ebd7df2bfc5a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1516 microversion: 2.1 time: 0.252040 Feb 20 20:06:19.072779 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 155/306] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:18 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1516 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:19.100742 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1c68a878-41c0-44ce-baac-45ccc768e3b6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c0e4c21-7eec-4805-9a91-7f8688a39734"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:06:19.102137 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1c68a878-41c0-44ce-baac-45ccc768e3b6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:19.112958 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1c68a878-41c0-44ce-baac-45ccc768e3b6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:19.112958 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1c68a878-41c0-44ce-baac-45ccc768e3b6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:19.113527 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1c68a878-41c0-44ce-baac-45ccc768e3b6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:19.114391 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1c68a878-41c0-44ce-baac-45ccc768e3b6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:19.177837 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-22dacde7-9c7e-46f7-91c7-fc12df77b3a3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:19.179750 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-22dacde7-9c7e-46f7-91c7-fc12df77b3a3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:19.193590 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-22dacde7-9c7e-46f7-91c7-fc12df77b3a3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:19.195476 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-22dacde7-9c7e-46f7-91c7-fc12df77b3a3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:19.197597 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-22dacde7-9c7e-46f7-91c7-fc12df77b3a3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:19.198736 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-22dacde7-9c7e-46f7-91c7-fc12df77b3a3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:19.429341 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-22dacde7-9c7e-46f7-91c7-fc12df77b3a3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:19.439545 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-22dacde7-9c7e-46f7-91c7-fc12df77b3a3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1721 microversion: 2.1 time: 0.266686 Feb 20 20:06:19.440158 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 156/307] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:19 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1721 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:19.456074 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-29ab6883-057a-4303-b6a9-8bae73aedd4f req-00bb98c2-e83a-41da-97a7-1d0ff2c79338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97", "name": "network-vif-plugged", "status": "completed", "tag": "87a52ebd-35dd-4b56-8924-9578f176542c"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:06:19.456869 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:06:19.456869 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:06:19.467440 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-29ab6883-057a-4303-b6a9-8bae73aedd4f req-00bb98c2-e83a-41da-97a7-1d0ff2c79338 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:19.467897 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-29ab6883-057a-4303-b6a9-8bae73aedd4f req-00bb98c2-e83a-41da-97a7-1d0ff2c79338 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:19.486468 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-29ab6883-057a-4303-b6a9-8bae73aedd4f req-00bb98c2-e83a-41da-97a7-1d0ff2c79338 service nova] Creating event network-vif-plugged:87a52ebd-35dd-4b56-8924-9578f176542c for instance d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 on hv-cinder-83008 Feb 20 20:06:19.492458 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-29ab6883-057a-4303-b6a9-8bae73aedd4f req-00bb98c2-e83a-41da-97a7-1d0ff2c79338 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050822 Feb 20 20:06:19.493262 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 157/308] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:06:19.499378 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b1324072-e798-4018-993c-5c2026dfe604 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:19.500125 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b1324072-e798-4018-993c-5c2026dfe604 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:19.506902 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b1324072-e798-4018-993c-5c2026dfe604 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:19.507377 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b1324072-e798-4018-993c-5c2026dfe604 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:19.508201 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b1324072-e798-4018-993c-5c2026dfe604 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:19.508627 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b1324072-e798-4018-993c-5c2026dfe604 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:19.750597 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b1324072-e798-4018-993c-5c2026dfe604 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:19.770141 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b1324072-e798-4018-993c-5c2026dfe604 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:19.774169 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b1324072-e798-4018-993c-5c2026dfe604 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:19.776453 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b1324072-e798-4018-993c-5c2026dfe604 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1742 microversion: 2.20 time: 0.281760 Feb 20 20:06:19.777397 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 158/309] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:19 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1742 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:20.354130 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1c68a878-41c0-44ce-baac-45ccc768e3b6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "POST /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.267930 Feb 20 20:06:20.358081 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 152/310] 10.222.0.60 () {60 vars in 1322 bytes} [Sun Feb 20 20:06:19 2022] POST /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments => generated 194 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:06:20.461267 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-afd10c2c-c2b8-4add-8819-9e272f7043b2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:20.461972 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-afd10c2c-c2b8-4add-8819-9e272f7043b2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:20.473346 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-afd10c2c-c2b8-4add-8819-9e272f7043b2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:20.473346 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-afd10c2c-c2b8-4add-8819-9e272f7043b2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:20.473547 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-afd10c2c-c2b8-4add-8819-9e272f7043b2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:20.473856 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-afd10c2c-c2b8-4add-8819-9e272f7043b2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:20.660720 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-afd10c2c-c2b8-4add-8819-9e272f7043b2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:20.671439 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-afd10c2c-c2b8-4add-8819-9e272f7043b2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1721 microversion: 2.1 time: 0.213916 Feb 20 20:06:20.672250 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 159/311] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:20 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:20.812729 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7daa6c6f-4401-4a8e-a48c-654172a0500c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:20.814359 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7daa6c6f-4401-4a8e-a48c-654172a0500c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:20.827398 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7daa6c6f-4401-4a8e-a48c-654172a0500c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:20.828187 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7daa6c6f-4401-4a8e-a48c-654172a0500c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:20.829784 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7daa6c6f-4401-4a8e-a48c-654172a0500c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:20.830576 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7daa6c6f-4401-4a8e-a48c-654172a0500c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:21.040381 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7daa6c6f-4401-4a8e-a48c-654172a0500c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:21.058367 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7daa6c6f-4401-4a8e-a48c-654172a0500c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:21.063028 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7daa6c6f-4401-4a8e-a48c-654172a0500c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:21.065074 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7daa6c6f-4401-4a8e-a48c-654172a0500c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1742 microversion: 2.20 time: 0.262888 Feb 20 20:06:21.066078 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 153/312] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:20 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1742 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:21.704364 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7934099b-10cc-4ba7-8f64-9b486aad7c22 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:21.705502 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7934099b-10cc-4ba7-8f64-9b486aad7c22 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:21.724682 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7934099b-10cc-4ba7-8f64-9b486aad7c22 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:21.725397 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7934099b-10cc-4ba7-8f64-9b486aad7c22 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:21.726331 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7934099b-10cc-4ba7-8f64-9b486aad7c22 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:21.727025 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7934099b-10cc-4ba7-8f64-9b486aad7c22 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:22.027850 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7934099b-10cc-4ba7-8f64-9b486aad7c22 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:22.041914 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7934099b-10cc-4ba7-8f64-9b486aad7c22 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1721 microversion: 2.1 time: 0.347677 Feb 20 20:06:22.042898 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 160/313] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:21 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1721 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:22.100674 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3381d07b-b782-4f0c-b08b-f8d1d98848ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:22.101871 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3381d07b-b782-4f0c-b08b-f8d1d98848ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:22.115507 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3381d07b-b782-4f0c-b08b-f8d1d98848ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:22.117400 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3381d07b-b782-4f0c-b08b-f8d1d98848ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:22.118276 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3381d07b-b782-4f0c-b08b-f8d1d98848ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:22.119197 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3381d07b-b782-4f0c-b08b-f8d1d98848ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:22.377233 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3381d07b-b782-4f0c-b08b-f8d1d98848ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:22.389129 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3381d07b-b782-4f0c-b08b-f8d1d98848ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:22.392444 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3381d07b-b782-4f0c-b08b-f8d1d98848ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:22.392980 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3381d07b-b782-4f0c-b08b-f8d1d98848ce tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1742 microversion: 2.20 time: 0.301493 Feb 20 20:06:22.393720 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 154/314] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:22 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1742 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:23.068469 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-11a748eb-a07b-40f7-afc0-891060ccb513 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:23.070019 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-11a748eb-a07b-40f7-afc0-891060ccb513 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:23.083280 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-11a748eb-a07b-40f7-afc0-891060ccb513 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:23.083982 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-11a748eb-a07b-40f7-afc0-891060ccb513 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:23.085485 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-11a748eb-a07b-40f7-afc0-891060ccb513 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:23.086333 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-11a748eb-a07b-40f7-afc0-891060ccb513 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:23.381883 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-11a748eb-a07b-40f7-afc0-891060ccb513 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:23.406233 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-11a748eb-a07b-40f7-afc0-891060ccb513 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1721 microversion: 2.1 time: 0.342142 Feb 20 20:06:23.407293 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 161/315] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:23 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1721 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:23.422540 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4aa631b5-4c61-4fb5-b1d1-8c0e257f30a6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:23.424628 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4aa631b5-4c61-4fb5-b1d1-8c0e257f30a6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:23.437925 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4aa631b5-4c61-4fb5-b1d1-8c0e257f30a6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:23.438757 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4aa631b5-4c61-4fb5-b1d1-8c0e257f30a6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:23.441681 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4aa631b5-4c61-4fb5-b1d1-8c0e257f30a6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:23.442418 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4aa631b5-4c61-4fb5-b1d1-8c0e257f30a6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:23.809304 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4aa631b5-4c61-4fb5-b1d1-8c0e257f30a6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:23.838383 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4aa631b5-4c61-4fb5-b1d1-8c0e257f30a6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:23.840997 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4aa631b5-4c61-4fb5-b1d1-8c0e257f30a6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:23.842850 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4aa631b5-4c61-4fb5-b1d1-8c0e257f30a6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1742 microversion: 2.20 time: 0.427720 Feb 20 20:06:23.844059 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 155/316] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:23 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1742 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:24.447877 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a87a70c9-5276-4c6d-90b4-3b649d9b2815 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:24.449161 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a87a70c9-5276-4c6d-90b4-3b649d9b2815 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:24.463689 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a87a70c9-5276-4c6d-90b4-3b649d9b2815 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:24.464464 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a87a70c9-5276-4c6d-90b4-3b649d9b2815 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:24.466681 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a87a70c9-5276-4c6d-90b4-3b649d9b2815 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:24.467478 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a87a70c9-5276-4c6d-90b4-3b649d9b2815 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:24.718172 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a87a70c9-5276-4c6d-90b4-3b649d9b2815 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:24.750234 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a87a70c9-5276-4c6d-90b4-3b649d9b2815 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1721 microversion: 2.1 time: 0.319997 Feb 20 20:06:24.752496 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 162/317] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:24 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1721 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:24.880061 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-91d84a99-f965-4807-af0c-7de86aafd054 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:24.881192 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-91d84a99-f965-4807-af0c-7de86aafd054 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:24.896914 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-91d84a99-f965-4807-af0c-7de86aafd054 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:24.897773 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-91d84a99-f965-4807-af0c-7de86aafd054 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:24.899176 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-91d84a99-f965-4807-af0c-7de86aafd054 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:24.899953 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-91d84a99-f965-4807-af0c-7de86aafd054 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:25.179890 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-91d84a99-f965-4807-af0c-7de86aafd054 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:25.192532 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-91d84a99-f965-4807-af0c-7de86aafd054 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:25.195533 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-91d84a99-f965-4807-af0c-7de86aafd054 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:25.197136 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-91d84a99-f965-4807-af0c-7de86aafd054 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1742 microversion: 2.20 time: 0.324687 Feb 20 20:06:25.197982 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 156/318] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:24 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1742 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:25.777117 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bf945355-522a-4f0d-afe8-e300f186cf81 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:25.779273 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-bf945355-522a-4f0d-afe8-e300f186cf81 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:25.790846 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bf945355-522a-4f0d-afe8-e300f186cf81 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:25.791730 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bf945355-522a-4f0d-afe8-e300f186cf81 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:25.793660 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bf945355-522a-4f0d-afe8-e300f186cf81 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:25.795069 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bf945355-522a-4f0d-afe8-e300f186cf81 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:26.082030 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-bf945355-522a-4f0d-afe8-e300f186cf81 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:26.099006 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-bf945355-522a-4f0d-afe8-e300f186cf81 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1721 microversion: 2.1 time: 0.332032 Feb 20 20:06:26.100003 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 163/319] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:25 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1721 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:26.222635 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-504360dd-26ba-49a0-9583-9fcc82f9521a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:26.227716 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-504360dd-26ba-49a0-9583-9fcc82f9521a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:26.243846 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-504360dd-26ba-49a0-9583-9fcc82f9521a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:26.244641 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-504360dd-26ba-49a0-9583-9fcc82f9521a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:26.246075 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-504360dd-26ba-49a0-9583-9fcc82f9521a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:26.251205 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-504360dd-26ba-49a0-9583-9fcc82f9521a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:26.523377 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-504360dd-26ba-49a0-9583-9fcc82f9521a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:26.540142 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-504360dd-26ba-49a0-9583-9fcc82f9521a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:26.542699 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-504360dd-26ba-49a0-9583-9fcc82f9521a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:26.546098 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-504360dd-26ba-49a0-9583-9fcc82f9521a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1742 microversion: 2.20 time: 0.329567 Feb 20 20:06:26.548201 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 157/320] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:26 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1742 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:27.155944 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-692cc2ed-53f7-4848-875a-a813f87b0784 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:27.174402 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-692cc2ed-53f7-4848-875a-a813f87b0784 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:27.205829 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-692cc2ed-53f7-4848-875a-a813f87b0784 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:27.207401 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-692cc2ed-53f7-4848-875a-a813f87b0784 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:27.209174 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-692cc2ed-53f7-4848-875a-a813f87b0784 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:27.210307 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-692cc2ed-53f7-4848-875a-a813f87b0784 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:27.540389 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-692cc2ed-53f7-4848-875a-a813f87b0784 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:27.565159 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-692cc2ed-53f7-4848-875a-a813f87b0784 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1721 microversion: 2.1 time: 0.439281 Feb 20 20:06:27.595478 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-59903f15-b506-426b-ac80-7c4a29db1d45 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:27.596778 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 164/321] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:27 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1721 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:27.598590 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-59903f15-b506-426b-ac80-7c4a29db1d45 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:27.611672 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-59903f15-b506-426b-ac80-7c4a29db1d45 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:27.613070 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-59903f15-b506-426b-ac80-7c4a29db1d45 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:27.614682 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-59903f15-b506-426b-ac80-7c4a29db1d45 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:27.615628 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-59903f15-b506-426b-ac80-7c4a29db1d45 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:27.995931 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-59903f15-b506-426b-ac80-7c4a29db1d45 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:28.015078 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-59903f15-b506-426b-ac80-7c4a29db1d45 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:28.033493 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-59903f15-b506-426b-ac80-7c4a29db1d45 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:28.039404 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-59903f15-b506-426b-ac80-7c4a29db1d45 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1742 microversion: 2.20 time: 0.456895 Feb 20 20:06:28.054502 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 158/322] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:27 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1742 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:28.601371 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9bc88b92-247f-4f56-b193-6de193f0843d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:28.602342 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9bc88b92-247f-4f56-b193-6de193f0843d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:28.614024 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9bc88b92-247f-4f56-b193-6de193f0843d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:28.617265 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9bc88b92-247f-4f56-b193-6de193f0843d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:28.623398 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9bc88b92-247f-4f56-b193-6de193f0843d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:28.623958 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9bc88b92-247f-4f56-b193-6de193f0843d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:28.934913 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9bc88b92-247f-4f56-b193-6de193f0843d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:28.952772 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9bc88b92-247f-4f56-b193-6de193f0843d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1721 microversion: 2.1 time: 0.358889 Feb 20 20:06:28.969901 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 165/323] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:28 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1721 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:29.080097 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7af18c69-6924-4eba-9ad1-4aaace4ecf5c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:29.081831 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7af18c69-6924-4eba-9ad1-4aaace4ecf5c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:29.118601 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7af18c69-6924-4eba-9ad1-4aaace4ecf5c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:29.120686 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7af18c69-6924-4eba-9ad1-4aaace4ecf5c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:29.127171 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7af18c69-6924-4eba-9ad1-4aaace4ecf5c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:29.130640 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7af18c69-6924-4eba-9ad1-4aaace4ecf5c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:29.239329 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-cc17fa77-7b9d-4e96-a182-2cb3f5f266cd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:06:29.241047 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-cc17fa77-7b9d-4e96-a182-2cb3f5f266cd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:29.251636 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cc17fa77-7b9d-4e96-a182-2cb3f5f266cd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:29.252468 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cc17fa77-7b9d-4e96-a182-2cb3f5f266cd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:29.254051 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cc17fa77-7b9d-4e96-a182-2cb3f5f266cd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:29.255035 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cc17fa77-7b9d-4e96-a182-2cb3f5f266cd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:29.326468 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-cc17fa77-7b9d-4e96-a182-2cb3f5f266cd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lazy-loading 'flavor' on Instance uuid 6e394c2c-f9ca-4e79-9a43-f6a04f887f71 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:06:29.533421 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7af18c69-6924-4eba-9ad1-4aaace4ecf5c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:29.550596 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7af18c69-6924-4eba-9ad1-4aaace4ecf5c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:29.553316 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7af18c69-6924-4eba-9ad1-4aaace4ecf5c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:29.556261 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7af18c69-6924-4eba-9ad1-4aaace4ecf5c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1742 microversion: 2.20 time: 0.486389 Feb 20 20:06:29.558049 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 159/324] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:29 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1742 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:29.867850 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-cc17fa77-7b9d-4e96-a182-2cb3f5f266cd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "POST /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/action" status: 200 len: 32 microversion: 2.1 time: 0.636584 Feb 20 20:06:29.869123 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 166/325] 10.222.0.60 () {60 vars in 1277 bytes} [Sun Feb 20 20:06:29 2022] POST /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/action => generated 32 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 20 20:06:29.884799 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-66ad8b1e-206a-4f0d-949b-f98be1a13850 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:29.886374 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-66ad8b1e-206a-4f0d-949b-f98be1a13850 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:29.908266 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-66ad8b1e-206a-4f0d-949b-f98be1a13850 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:29.910166 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-66ad8b1e-206a-4f0d-949b-f98be1a13850 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:29.912845 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-66ad8b1e-206a-4f0d-949b-f98be1a13850 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:29.915652 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-66ad8b1e-206a-4f0d-949b-f98be1a13850 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:29.994610 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8e8846d9-74b9-4575-9613-ee4d2355544a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:29.999818 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8e8846d9-74b9-4575-9613-ee4d2355544a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:30.012123 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8e8846d9-74b9-4575-9613-ee4d2355544a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:30.021729 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8e8846d9-74b9-4575-9613-ee4d2355544a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:30.023745 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8e8846d9-74b9-4575-9613-ee4d2355544a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:30.025768 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8e8846d9-74b9-4575-9613-ee4d2355544a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:30.399898 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-66ad8b1e-206a-4f0d-949b-f98be1a13850 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:30.406785 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8e8846d9-74b9-4575-9613-ee4d2355544a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:30.425188 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8e8846d9-74b9-4575-9613-ee4d2355544a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1721 microversion: 2.1 time: 0.443793 Feb 20 20:06:30.440532 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 167/326] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:29 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1721 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:30.460865 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-66ad8b1e-206a-4f0d-949b-f98be1a13850 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1568 microversion: 2.1 time: 0.582243 Feb 20 20:06:30.477785 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 160/327] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:29 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1568 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:30.589463 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c53d5221-9334-4d36-860a-13bb0f39006e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:30.590973 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c53d5221-9334-4d36-860a-13bb0f39006e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:30.601387 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c53d5221-9334-4d36-860a-13bb0f39006e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:30.602067 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c53d5221-9334-4d36-860a-13bb0f39006e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:30.602992 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c53d5221-9334-4d36-860a-13bb0f39006e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:30.604820 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c53d5221-9334-4d36-860a-13bb0f39006e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:31.179696 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c53d5221-9334-4d36-860a-13bb0f39006e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:31.194490 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c53d5221-9334-4d36-860a-13bb0f39006e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:31.196028 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c53d5221-9334-4d36-860a-13bb0f39006e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:31.197608 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c53d5221-9334-4d36-860a-13bb0f39006e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1742 microversion: 2.20 time: 0.613828 Feb 20 20:06:31.198339 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 168/328] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:30 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1742 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:31.447757 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f6c39b73-7c34-4d4d-9b63-7db24ada2c75 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:31.450005 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f6c39b73-7c34-4d4d-9b63-7db24ada2c75 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:31.462974 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f6c39b73-7c34-4d4d-9b63-7db24ada2c75 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:31.463509 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f6c39b73-7c34-4d4d-9b63-7db24ada2c75 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:31.465137 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f6c39b73-7c34-4d4d-9b63-7db24ada2c75 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:31.465924 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f6c39b73-7c34-4d4d-9b63-7db24ada2c75 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:31.499810 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ddc84947-c30e-40bb-9ba2-67d585f7c944 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:31.501802 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ddc84947-c30e-40bb-9ba2-67d585f7c944 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:31.518657 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ddc84947-c30e-40bb-9ba2-67d585f7c944 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:31.519634 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ddc84947-c30e-40bb-9ba2-67d585f7c944 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:31.520760 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ddc84947-c30e-40bb-9ba2-67d585f7c944 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:31.521430 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ddc84947-c30e-40bb-9ba2-67d585f7c944 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:31.786515 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f6c39b73-7c34-4d4d-9b63-7db24ada2c75 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:31.790603 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ddc84947-c30e-40bb-9ba2-67d585f7c944 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:31.798841 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f6c39b73-7c34-4d4d-9b63-7db24ada2c75 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1721 microversion: 2.1 time: 0.359143 Feb 20 20:06:31.799874 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 161/329] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:31 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1721 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:31.809795 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ddc84947-c30e-40bb-9ba2-67d585f7c944 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1568 microversion: 2.1 time: 0.320956 Feb 20 20:06:31.817223 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 169/330] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:31 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1568 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:32.227553 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a967936a-9170-471c-ae94-8483b97db6b3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:32.232539 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a967936a-9170-471c-ae94-8483b97db6b3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:32.245801 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a967936a-9170-471c-ae94-8483b97db6b3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:32.246007 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a967936a-9170-471c-ae94-8483b97db6b3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:32.247430 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a967936a-9170-471c-ae94-8483b97db6b3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:32.248420 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a967936a-9170-471c-ae94-8483b97db6b3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:32.592457 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a967936a-9170-471c-ae94-8483b97db6b3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:32.607560 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a967936a-9170-471c-ae94-8483b97db6b3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:32.609131 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a967936a-9170-471c-ae94-8483b97db6b3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:32.610356 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a967936a-9170-471c-ae94-8483b97db6b3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1742 microversion: 2.20 time: 0.389572 Feb 20 20:06:32.611169 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 162/331] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:32 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1742 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:32.825688 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bc071fc5-9b7f-4841-a584-d58e0611cefb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:32.826559 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-bc071fc5-9b7f-4841-a584-d58e0611cefb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:32.838981 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8ed0cdf4-5f30-4c30-987e-2b70f5a3ef65 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:32.839982 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8ed0cdf4-5f30-4c30-987e-2b70f5a3ef65 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:32.851903 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bc071fc5-9b7f-4841-a584-d58e0611cefb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:32.853736 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bc071fc5-9b7f-4841-a584-d58e0611cefb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:32.855255 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bc071fc5-9b7f-4841-a584-d58e0611cefb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:32.858217 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bc071fc5-9b7f-4841-a584-d58e0611cefb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:32.861739 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8ed0cdf4-5f30-4c30-987e-2b70f5a3ef65 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:32.862488 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8ed0cdf4-5f30-4c30-987e-2b70f5a3ef65 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:32.863937 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8ed0cdf4-5f30-4c30-987e-2b70f5a3ef65 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:32.869020 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8ed0cdf4-5f30-4c30-987e-2b70f5a3ef65 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:33.383902 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-bc071fc5-9b7f-4841-a584-d58e0611cefb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:33.394974 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8ed0cdf4-5f30-4c30-987e-2b70f5a3ef65 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:33.400514 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-bc071fc5-9b7f-4841-a584-d58e0611cefb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1721 microversion: 2.1 time: 0.579064 Feb 20 20:06:33.402221 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 170/332] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:32 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1721 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:33.415780 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8ed0cdf4-5f30-4c30-987e-2b70f5a3ef65 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1568 microversion: 2.1 time: 0.580159 Feb 20 20:06:33.418308 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 163/333] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:32 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1568 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:33.642497 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-dfb2b2b7-968e-4d02-a4a6-3a81335e41f2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:33.643611 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-dfb2b2b7-968e-4d02-a4a6-3a81335e41f2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:33.657122 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dfb2b2b7-968e-4d02-a4a6-3a81335e41f2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:33.658907 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dfb2b2b7-968e-4d02-a4a6-3a81335e41f2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:33.660674 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dfb2b2b7-968e-4d02-a4a6-3a81335e41f2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:33.661726 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dfb2b2b7-968e-4d02-a4a6-3a81335e41f2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:33.930747 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-dfb2b2b7-968e-4d02-a4a6-3a81335e41f2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:33.947591 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-dfb2b2b7-968e-4d02-a4a6-3a81335e41f2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:33.950529 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-dfb2b2b7-968e-4d02-a4a6-3a81335e41f2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:33.953071 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-dfb2b2b7-968e-4d02-a4a6-3a81335e41f2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1742 microversion: 2.20 time: 0.323833 Feb 20 20:06:33.953986 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 171/334] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:33 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1742 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:34.461682 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-263da645-895e-4282-8ff9-7236ca80aafc tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:34.463483 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-71836027-24d6-4639-aac9-7f47bb4aeee8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:34.469434 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-263da645-895e-4282-8ff9-7236ca80aafc tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:34.474892 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-71836027-24d6-4639-aac9-7f47bb4aeee8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:34.507337 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-263da645-895e-4282-8ff9-7236ca80aafc tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:34.507997 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-263da645-895e-4282-8ff9-7236ca80aafc tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:34.518364 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-71836027-24d6-4639-aac9-7f47bb4aeee8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:34.519167 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-71836027-24d6-4639-aac9-7f47bb4aeee8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:34.520576 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-71836027-24d6-4639-aac9-7f47bb4aeee8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:34.525066 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-263da645-895e-4282-8ff9-7236ca80aafc tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:34.526446 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-263da645-895e-4282-8ff9-7236ca80aafc tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:34.538162 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-71836027-24d6-4639-aac9-7f47bb4aeee8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:35.173238 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-263da645-895e-4282-8ff9-7236ca80aafc tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:35.186098 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-263da645-895e-4282-8ff9-7236ca80aafc tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1568 microversion: 2.1 time: 0.748741 Feb 20 20:06:35.188407 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 172/335] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:34 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1568 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:35.193342 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-71836027-24d6-4639-aac9-7f47bb4aeee8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:35.193641 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-fd2096bd-fa49-4c2b-93ec-48ee8fe938a0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:35.194176 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-fd2096bd-fa49-4c2b-93ec-48ee8fe938a0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:35.203412 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fd2096bd-fa49-4c2b-93ec-48ee8fe938a0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:35.203412 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fd2096bd-fa49-4c2b-93ec-48ee8fe938a0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:35.203848 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fd2096bd-fa49-4c2b-93ec-48ee8fe938a0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:35.204143 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fd2096bd-fa49-4c2b-93ec-48ee8fe938a0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:35.222418 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-71836027-24d6-4639-aac9-7f47bb4aeee8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1721 microversion: 2.1 time: 0.790648 Feb 20 20:06:35.223782 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 164/336] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:34 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1721 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:35.458843 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-fd2096bd-fa49-4c2b-93ec-48ee8fe938a0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:35.474544 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-fd2096bd-fa49-4c2b-93ec-48ee8fe938a0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:35.477337 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-fd2096bd-fa49-4c2b-93ec-48ee8fe938a0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:35.479366 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-fd2096bd-fa49-4c2b-93ec-48ee8fe938a0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1742 microversion: 2.20 time: 0.289512 Feb 20 20:06:35.480358 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 173/337] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:35 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1742 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:36.228359 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-47ee2f90-e515-49d0-83b0-38504b4bc84d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:36.230514 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-47ee2f90-e515-49d0-83b0-38504b4bc84d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:36.253947 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-47ee2f90-e515-49d0-83b0-38504b4bc84d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:36.255136 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-47ee2f90-e515-49d0-83b0-38504b4bc84d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:36.257332 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-47ee2f90-e515-49d0-83b0-38504b4bc84d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:36.258058 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-47ee2f90-e515-49d0-83b0-38504b4bc84d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:36.263594 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-02c27652-c9dd-424c-9bde-d98a1159cc0d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:36.264721 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-02c27652-c9dd-424c-9bde-d98a1159cc0d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:36.279507 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-02c27652-c9dd-424c-9bde-d98a1159cc0d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:36.280561 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-02c27652-c9dd-424c-9bde-d98a1159cc0d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:36.286902 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-02c27652-c9dd-424c-9bde-d98a1159cc0d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:36.287717 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-02c27652-c9dd-424c-9bde-d98a1159cc0d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:36.714403 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-47ee2f90-e515-49d0-83b0-38504b4bc84d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:36.736549 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-47ee2f90-e515-49d0-83b0-38504b4bc84d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1568 microversion: 2.1 time: 0.517666 Feb 20 20:06:36.740841 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-02c27652-c9dd-424c-9bde-d98a1159cc0d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:36.752204 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 165/338] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:36 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1568 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:36.768022 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-0a0f4939-fe25-4b50-b0c4-bcb2dcc5f2d6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:36.768622 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-0a0f4939-fe25-4b50-b0c4-bcb2dcc5f2d6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:36.783804 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-02c27652-c9dd-424c-9bde-d98a1159cc0d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1721 microversion: 2.1 time: 0.531784 Feb 20 20:06:36.790079 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0a0f4939-fe25-4b50-b0c4-bcb2dcc5f2d6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:36.790589 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0a0f4939-fe25-4b50-b0c4-bcb2dcc5f2d6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:36.791506 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0a0f4939-fe25-4b50-b0c4-bcb2dcc5f2d6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:36.791936 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0a0f4939-fe25-4b50-b0c4-bcb2dcc5f2d6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:36.794020 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 174/339] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:36 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1721 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:37.117531 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0a0f4939-fe25-4b50-b0c4-bcb2dcc5f2d6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:37.132262 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0a0f4939-fe25-4b50-b0c4-bcb2dcc5f2d6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:37.134891 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0a0f4939-fe25-4b50-b0c4-bcb2dcc5f2d6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:37.136477 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-0a0f4939-fe25-4b50-b0c4-bcb2dcc5f2d6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1742 microversion: 2.20 time: 0.383468 Feb 20 20:06:37.137299 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 166/340] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:36 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1742 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:37.766123 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8ddc3db2-a4f3-4c4f-9dfa-fba344c7454e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:37.767630 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8ddc3db2-a4f3-4c4f-9dfa-fba344c7454e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:37.775893 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8ddc3db2-a4f3-4c4f-9dfa-fba344c7454e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:37.776559 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8ddc3db2-a4f3-4c4f-9dfa-fba344c7454e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:37.777520 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8ddc3db2-a4f3-4c4f-9dfa-fba344c7454e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:37.778011 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8ddc3db2-a4f3-4c4f-9dfa-fba344c7454e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:37.833024 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-77cc35b0-831c-49d8-ac31-a9feac331014 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:37.834916 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-77cc35b0-831c-49d8-ac31-a9feac331014 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:37.870952 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-77cc35b0-831c-49d8-ac31-a9feac331014 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:37.872250 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-77cc35b0-831c-49d8-ac31-a9feac331014 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:37.879151 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-77cc35b0-831c-49d8-ac31-a9feac331014 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:37.883013 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-77cc35b0-831c-49d8-ac31-a9feac331014 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:38.278237 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8ddc3db2-a4f3-4c4f-9dfa-fba344c7454e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:38.296707 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8ddc3db2-a4f3-4c4f-9dfa-fba344c7454e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1568 microversion: 2.1 time: 0.541194 Feb 20 20:06:38.298348 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 175/341] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:37 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1568 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:38.306867 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-52ce3367-b1a4-4d89-a9ba-381fb9f7849f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-386433652", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1960512012", "security_groups": [{"name": "tempest-secgroup-smoke-1278078586"}], "networks": [{"uuid": "d20a7ac2-8104-4134-8a26-24a979518d49"}], "block_device_mapping_v2": [{"uuid": "93e9dc0c-6a8b-4be0-8486-5eb3ecfebb0e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:06:38.393682 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-77cc35b0-831c-49d8-ac31-a9feac331014 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:38.410509 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-77cc35b0-831c-49d8-ac31-a9feac331014 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1721 microversion: 2.1 time: 0.583089 Feb 20 20:06:38.412609 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 167/342] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:37 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1721 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:38.420380 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-bfae7ac3-a884-47af-af53-bae5d45dda9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:38.421813 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-bfae7ac3-a884-47af-af53-bae5d45dda9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:38.429634 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bfae7ac3-a884-47af-af53-bae5d45dda9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:38.430430 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bfae7ac3-a884-47af-af53-bae5d45dda9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:38.431632 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bfae7ac3-a884-47af-af53-bae5d45dda9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:38.432377 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bfae7ac3-a884-47af-af53-bae5d45dda9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:38.574636 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.network.neutron [None req-52ce3367-b1a4-4d89-a9ba-381fb9f7849f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] validate_networks() for [('d20a7ac2-8104-4134-8a26-24a979518d49', None, None, None, None, None)] {{(pid=117088) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 20 20:06:38.870231 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-bfae7ac3-a884-47af-af53-bae5d45dda9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:38.881369 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-bfae7ac3-a884-47af-af53-bae5d45dda9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:38.885162 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-bfae7ac3-a884-47af-af53-bae5d45dda9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:38.889662 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-bfae7ac3-a884-47af-af53-bae5d45dda9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1742 microversion: 2.20 time: 0.474765 Feb 20 20:06:38.901342 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 168/343] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:38 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1742 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:39.314592 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-336c3184-8202-4bf1-bc98-1e14c94f33a6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-387648237", "imageRef": "61c0cc70-53e3-40ed-b353-ec1b5fc4eea4", "flavorRef": "452"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:06:39.514749 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-52ce3367-b1a4-4d89-a9ba-381fb9f7849f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Flavor limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 20 20:06:39.516340 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-52ce3367-b1a4-4d89-a9ba-381fb9f7849f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Image limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 20 20:06:39.517569 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-52ce3367-b1a4-4d89-a9ba-381fb9f7849f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Flavor pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 20 20:06:39.518291 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-52ce3367-b1a4-4d89-a9ba-381fb9f7849f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Image pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 20 20:06:39.519202 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-52ce3367-b1a4-4d89-a9ba-381fb9f7849f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 20 20:06:39.540062 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-52ce3367-b1a4-4d89-a9ba-381fb9f7849f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:39.541635 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-52ce3367-b1a4-4d89-a9ba-381fb9f7849f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:39.543352 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-52ce3367-b1a4-4d89-a9ba-381fb9f7849f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:39.544577 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-52ce3367-b1a4-4d89-a9ba-381fb9f7849f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:39.583547 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-52ce3367-b1a4-4d89-a9ba-381fb9f7849f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Getting quotas for project 2c8e34338e9a48629be67b295d115a7a. Resources: {'instances', 'cores', 'ram'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:06:39.592104 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-52ce3367-b1a4-4d89-a9ba-381fb9f7849f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Getting quotas for user 2dadec92c12145649a5381cd0fd4c462 and project 2c8e34338e9a48629be67b295d115a7a. Resources: {'instances', 'cores', 'ram'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:06:39.696682 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-52ce3367-b1a4-4d89-a9ba-381fb9f7849f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Going to run 1 instances... {{(pid=117088) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 20 20:06:39.698885 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-52ce3367-b1a4-4d89-a9ba-381fb9f7849f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='93e9dc0c-6a8b-4be0-8486-5eb3ecfebb0e',volume_size=None,volume_type=None)] {{(pid=117088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 20 20:06:40.283084 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-52ce3367-b1a4-4d89-a9ba-381fb9f7849f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.983037 Feb 20 20:06:40.287351 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 176/344] 10.222.0.60 () {60 vars in 1146 bytes} [Sun Feb 20 20:06:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 20 20:06:40.309543 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ee03b1e5-bed1-4328-ba31-9b591feb5783 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:40.311212 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ee03b1e5-bed1-4328-ba31-9b591feb5783 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:40.321985 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ee03b1e5-bed1-4328-ba31-9b591feb5783 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:40.324693 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ee03b1e5-bed1-4328-ba31-9b591feb5783 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:40.327291 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ee03b1e5-bed1-4328-ba31-9b591feb5783 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:40.328718 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ee03b1e5-bed1-4328-ba31-9b591feb5783 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:40.722101 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ee03b1e5-bed1-4328-ba31-9b591feb5783 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:40.744867 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ee03b1e5-bed1-4328-ba31-9b591feb5783 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1568 microversion: 2.1 time: 0.455373 Feb 20 20:06:40.746321 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 177/345] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:40 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1568 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:40.755661 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-34f6be22-050e-4223-b979-ce7cbf94b990 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:40.757168 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-34f6be22-050e-4223-b979-ce7cbf94b990 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:40.769291 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-34f6be22-050e-4223-b979-ce7cbf94b990 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:40.771596 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-34f6be22-050e-4223-b979-ce7cbf94b990 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:40.774420 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-34f6be22-050e-4223-b979-ce7cbf94b990 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:40.775710 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-34f6be22-050e-4223-b979-ce7cbf94b990 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:41.376308 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-34f6be22-050e-4223-b979-ce7cbf94b990 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:41.393636 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-34f6be22-050e-4223-b979-ce7cbf94b990 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1721 microversion: 2.1 time: 0.644728 Feb 20 20:06:41.400777 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 178/346] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:40 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1721 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:41.452177 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9699f393-f167-48f4-baea-588bc9613d63 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:41.453069 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9699f393-f167-48f4-baea-588bc9613d63 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:41.479972 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9699f393-f167-48f4-baea-588bc9613d63 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:41.480601 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9699f393-f167-48f4-baea-588bc9613d63 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:41.482472 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9699f393-f167-48f4-baea-588bc9613d63 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:41.485710 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9699f393-f167-48f4-baea-588bc9613d63 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:41.898235 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9699f393-f167-48f4-baea-588bc9613d63 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:41.938004 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9699f393-f167-48f4-baea-588bc9613d63 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:41.938004 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9699f393-f167-48f4-baea-588bc9613d63 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:41.938657 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9699f393-f167-48f4-baea-588bc9613d63 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1742 microversion: 2.20 time: 0.534724 Feb 20 20:06:41.949129 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 179/347] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:41 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1742 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:41.949129 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8e5f46ca-1fce-42c7-b9b6-ee986892e2fd tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:41.949650 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8e5f46ca-1fce-42c7-b9b6-ee986892e2fd tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:41.973167 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8e5f46ca-1fce-42c7-b9b6-ee986892e2fd tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:41.973167 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8e5f46ca-1fce-42c7-b9b6-ee986892e2fd tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:41.975447 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8e5f46ca-1fce-42c7-b9b6-ee986892e2fd tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:41.976138 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8e5f46ca-1fce-42c7-b9b6-ee986892e2fd tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:42.102544 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8e5f46ca-1fce-42c7-b9b6-ee986892e2fd tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:42.115183 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8e5f46ca-1fce-42c7-b9b6-ee986892e2fd tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1138 microversion: 2.1 time: 0.172335 Feb 20 20:06:42.117180 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 180/348] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:41 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1138 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:42.125914 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d07b8cd8-c974-4a5d-ba74-e4165c13f3e1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:42.127051 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d07b8cd8-c974-4a5d-ba74-e4165c13f3e1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:42.147245 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d07b8cd8-c974-4a5d-ba74-e4165c13f3e1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:42.148048 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d07b8cd8-c974-4a5d-ba74-e4165c13f3e1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:42.151306 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d07b8cd8-c974-4a5d-ba74-e4165c13f3e1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:42.152111 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d07b8cd8-c974-4a5d-ba74-e4165c13f3e1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:42.365951 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d07b8cd8-c974-4a5d-ba74-e4165c13f3e1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:42.394329 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d07b8cd8-c974-4a5d-ba74-e4165c13f3e1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1568 microversion: 2.1 time: 0.276364 Feb 20 20:06:42.396203 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 181/349] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:42 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1568 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:42.435368 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ad9faa80-7cb4-4747-8aa9-033732a32104 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:42.436241 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ad9faa80-7cb4-4747-8aa9-033732a32104 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:42.443982 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ad9faa80-7cb4-4747-8aa9-033732a32104 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:42.444808 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ad9faa80-7cb4-4747-8aa9-033732a32104 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:42.445989 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ad9faa80-7cb4-4747-8aa9-033732a32104 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:42.446529 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ad9faa80-7cb4-4747-8aa9-033732a32104 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:42.677298 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ad9faa80-7cb4-4747-8aa9-033732a32104 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:42.687331 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ad9faa80-7cb4-4747-8aa9-033732a32104 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1721 microversion: 2.1 time: 0.259382 Feb 20 20:06:42.687932 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 182/350] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:42 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:42.967071 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a1b2c999-3dc4-4fe8-aa3f-1d134ee1a342 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:42.970545 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a1b2c999-3dc4-4fe8-aa3f-1d134ee1a342 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:42.984221 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a1b2c999-3dc4-4fe8-aa3f-1d134ee1a342 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:42.985643 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a1b2c999-3dc4-4fe8-aa3f-1d134ee1a342 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:42.987258 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a1b2c999-3dc4-4fe8-aa3f-1d134ee1a342 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:42.988253 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a1b2c999-3dc4-4fe8-aa3f-1d134ee1a342 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:43.339044 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a1b2c999-3dc4-4fe8-aa3f-1d134ee1a342 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:43.371984 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a1b2c999-3dc4-4fe8-aa3f-1d134ee1a342 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:43.374554 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a1b2c999-3dc4-4fe8-aa3f-1d134ee1a342 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:43.375963 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a1b2c999-3dc4-4fe8-aa3f-1d134ee1a342 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1742 microversion: 2.20 time: 0.417088 Feb 20 20:06:43.376690 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 183/351] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:42 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1742 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:43.397400 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2b27a32f-cf41-41ea-94b7-f74534a37b14 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:43.399187 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2b27a32f-cf41-41ea-94b7-f74534a37b14 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:43.410014 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2b27a32f-cf41-41ea-94b7-f74534a37b14 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:43.410760 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2b27a32f-cf41-41ea-94b7-f74534a37b14 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:43.411751 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2b27a32f-cf41-41ea-94b7-f74534a37b14 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:43.412203 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2b27a32f-cf41-41ea-94b7-f74534a37b14 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:43.556506 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2b27a32f-cf41-41ea-94b7-f74534a37b14 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:43.567341 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2b27a32f-cf41-41ea-94b7-f74534a37b14 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1186 microversion: 2.1 time: 0.175977 Feb 20 20:06:43.574111 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 184/352] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:43 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1186 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:43.592541 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-02359f2d-35f7-4067-b59d-c9ebbecd4875 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:43.594144 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-02359f2d-35f7-4067-b59d-c9ebbecd4875 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:43.622914 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-02359f2d-35f7-4067-b59d-c9ebbecd4875 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:43.624351 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-02359f2d-35f7-4067-b59d-c9ebbecd4875 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:43.629117 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-02359f2d-35f7-4067-b59d-c9ebbecd4875 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:43.629659 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-02359f2d-35f7-4067-b59d-c9ebbecd4875 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:43.642319 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.network.neutron [None req-336c3184-8202-4bf1-bc98-1e14c94f33a6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] validate_networks() for None {{(pid=117087) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 20 20:06:44.411616 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-02359f2d-35f7-4067-b59d-c9ebbecd4875 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:44.427312 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-02359f2d-35f7-4067-b59d-c9ebbecd4875 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1568 microversion: 2.1 time: 0.845290 Feb 20 20:06:44.438478 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 185/353] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:43 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1568 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:44.438478 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-908ce64f-3015-4bdf-8958-f5c47b056af7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:44.438478 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-908ce64f-3015-4bdf-8958-f5c47b056af7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:44.441002 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-908ce64f-3015-4bdf-8958-f5c47b056af7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:44.441684 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-908ce64f-3015-4bdf-8958-f5c47b056af7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:44.442513 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-908ce64f-3015-4bdf-8958-f5c47b056af7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:44.443120 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-908ce64f-3015-4bdf-8958-f5c47b056af7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:44.497361 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-336c3184-8202-4bf1-bc98-1e14c94f33a6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Flavor limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 20 20:06:44.497361 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-336c3184-8202-4bf1-bc98-1e14c94f33a6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Image limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 20 20:06:44.498771 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-336c3184-8202-4bf1-bc98-1e14c94f33a6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Flavor pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 20 20:06:44.499618 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-336c3184-8202-4bf1-bc98-1e14c94f33a6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Image pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 20 20:06:44.500336 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-336c3184-8202-4bf1-bc98-1e14c94f33a6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 20 20:06:44.517401 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-336c3184-8202-4bf1-bc98-1e14c94f33a6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:44.518158 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-336c3184-8202-4bf1-bc98-1e14c94f33a6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:44.526117 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-336c3184-8202-4bf1-bc98-1e14c94f33a6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:44.526117 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-336c3184-8202-4bf1-bc98-1e14c94f33a6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:44.556389 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-336c3184-8202-4bf1-bc98-1e14c94f33a6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Getting quotas for project da90cec6e9b24aeab219d95489ccb6ce. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:06:44.569074 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-336c3184-8202-4bf1-bc98-1e14c94f33a6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Getting quotas for user 2d780561bcc8449ba44023470a01f733 and project da90cec6e9b24aeab219d95489ccb6ce. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:06:44.594671 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-336c3184-8202-4bf1-bc98-1e14c94f33a6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Going to run 1 instances... {{(pid=117087) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 20 20:06:44.598680 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-336c3184-8202-4bf1-bc98-1e14c94f33a6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61c0cc70-53e3-40ed-b353-ec1b5fc4eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 20 20:06:44.743445 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-336c3184-8202-4bf1-bc98-1e14c94f33a6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.440805 Feb 20 20:06:44.750224 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 169/354] 10.222.0.60 () {60 vars in 1146 bytes} [Sun Feb 20 20:06:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 5449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 20 20:06:44.755742 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6ab636f9-789d-42b4-b1bf-4db1771abe5e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:44.756357 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6ab636f9-789d-42b4-b1bf-4db1771abe5e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:44.763842 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6ab636f9-789d-42b4-b1bf-4db1771abe5e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:44.764500 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6ab636f9-789d-42b4-b1bf-4db1771abe5e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:44.765376 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6ab636f9-789d-42b4-b1bf-4db1771abe5e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:44.765989 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6ab636f9-789d-42b4-b1bf-4db1771abe5e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:44.813597 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-908ce64f-3015-4bdf-8958-f5c47b056af7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:44.838509 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-908ce64f-3015-4bdf-8958-f5c47b056af7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1721 microversion: 2.1 time: 0.406901 Feb 20 20:06:44.839053 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 186/355] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:44 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1721 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:44.857812 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-06bc0b30-2011-4bb8-806a-f6fa766700de tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:44.882950 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-06bc0b30-2011-4bb8-806a-f6fa766700de tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:44.897704 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-06bc0b30-2011-4bb8-806a-f6fa766700de tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:44.898345 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-06bc0b30-2011-4bb8-806a-f6fa766700de tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:44.899651 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-06bc0b30-2011-4bb8-806a-f6fa766700de tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:44.900412 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-06bc0b30-2011-4bb8-806a-f6fa766700de tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:45.054743 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-06bc0b30-2011-4bb8-806a-f6fa766700de tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:45.074358 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-06bc0b30-2011-4bb8-806a-f6fa766700de tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1204 microversion: 2.1 time: 0.232744 Feb 20 20:06:45.075377 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 187/356] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:44 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1204 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:45.083524 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-74da1b92-2cea-4b51-8ec4-d83fd3856668 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:45.084432 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-74da1b92-2cea-4b51-8ec4-d83fd3856668 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:45.207556 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-74da1b92-2cea-4b51-8ec4-d83fd3856668 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:45.209522 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6ab636f9-789d-42b4-b1bf-4db1771abe5e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:45.222538 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-74da1b92-2cea-4b51-8ec4-d83fd3856668 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1214 microversion: 2.1 time: 0.145145 Feb 20 20:06:45.227161 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6ab636f9-789d-42b4-b1bf-4db1771abe5e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:45.227415 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 188/357] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:45 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1214 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:45.230191 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6ab636f9-789d-42b4-b1bf-4db1771abe5e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:45.232609 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6ab636f9-789d-42b4-b1bf-4db1771abe5e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1742 microversion: 2.20 time: 0.480552 Feb 20 20:06:45.233649 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 170/358] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:44 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1742 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:45.449822 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-105646c5-d257-4e0d-9d0c-429af9d54c08 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:45.450874 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-105646c5-d257-4e0d-9d0c-429af9d54c08 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:45.458664 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-105646c5-d257-4e0d-9d0c-429af9d54c08 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:45.459448 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-105646c5-d257-4e0d-9d0c-429af9d54c08 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:45.460386 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-105646c5-d257-4e0d-9d0c-429af9d54c08 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:45.461012 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-105646c5-d257-4e0d-9d0c-429af9d54c08 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:45.815337 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-105646c5-d257-4e0d-9d0c-429af9d54c08 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:45.843682 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-105646c5-d257-4e0d-9d0c-429af9d54c08 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1568 microversion: 2.1 time: 0.400623 Feb 20 20:06:45.844911 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 189/359] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:45 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1568 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:45.862497 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a8ff9914-dd4a-4492-8d5e-8b5e150febdf tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:45.863648 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a8ff9914-dd4a-4492-8d5e-8b5e150febdf tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:45.877593 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a8ff9914-dd4a-4492-8d5e-8b5e150febdf tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:45.878851 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a8ff9914-dd4a-4492-8d5e-8b5e150febdf tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:45.880508 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a8ff9914-dd4a-4492-8d5e-8b5e150febdf tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:45.881598 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a8ff9914-dd4a-4492-8d5e-8b5e150febdf tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:46.107943 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-177b5e0f-861b-4ea2-aa5b-8eb619861a34 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:46.108822 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-177b5e0f-861b-4ea2-aa5b-8eb619861a34 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:46.124954 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-177b5e0f-861b-4ea2-aa5b-8eb619861a34 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:46.125701 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-177b5e0f-861b-4ea2-aa5b-8eb619861a34 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:46.127658 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-177b5e0f-861b-4ea2-aa5b-8eb619861a34 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:46.128555 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-177b5e0f-861b-4ea2-aa5b-8eb619861a34 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:46.518073 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a8ff9914-dd4a-4492-8d5e-8b5e150febdf tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:46.538901 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a8ff9914-dd4a-4492-8d5e-8b5e150febdf tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1721 microversion: 2.1 time: 0.683195 Feb 20 20:06:46.541242 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 171/360] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:45 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1721 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:46.553936 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d3b501d9-ba4a-4fca-b612-a4be638a8660 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:46.555969 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d3b501d9-ba4a-4fca-b612-a4be638a8660 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:46.572140 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d3b501d9-ba4a-4fca-b612-a4be638a8660 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:46.573214 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d3b501d9-ba4a-4fca-b612-a4be638a8660 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:46.574810 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d3b501d9-ba4a-4fca-b612-a4be638a8660 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:46.575780 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d3b501d9-ba4a-4fca-b612-a4be638a8660 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:46.691021 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-177b5e0f-861b-4ea2-aa5b-8eb619861a34 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:46.709212 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-177b5e0f-861b-4ea2-aa5b-8eb619861a34 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1272 microversion: 2.1 time: 0.608931 Feb 20 20:06:46.711214 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 190/361] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:46 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1272 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:46.728047 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-efc508a3-b23b-4bcb-b50d-b8a7d605dd5d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:46.729454 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-efc508a3-b23b-4bcb-b50d-b8a7d605dd5d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:46.736678 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d3b501d9-ba4a-4fca-b612-a4be638a8660 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:46.750416 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-efc508a3-b23b-4bcb-b50d-b8a7d605dd5d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:46.756171 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-efc508a3-b23b-4bcb-b50d-b8a7d605dd5d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:46.757883 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-efc508a3-b23b-4bcb-b50d-b8a7d605dd5d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:46.759484 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d3b501d9-ba4a-4fca-b612-a4be638a8660 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1218 microversion: 2.1 time: 0.216160 Feb 20 20:06:46.760198 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-efc508a3-b23b-4bcb-b50d-b8a7d605dd5d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:46.773468 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 172/362] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:46 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1218 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:46.866444 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-09d9b896-c2bd-4554-89d1-a0729e0855bb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:46.868434 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-09d9b896-c2bd-4554-89d1-a0729e0855bb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:46.882845 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-09d9b896-c2bd-4554-89d1-a0729e0855bb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:46.884311 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-09d9b896-c2bd-4554-89d1-a0729e0855bb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:46.886811 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-09d9b896-c2bd-4554-89d1-a0729e0855bb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:46.888773 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-09d9b896-c2bd-4554-89d1-a0729e0855bb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:47.200898 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-efc508a3-b23b-4bcb-b50d-b8a7d605dd5d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:47.226347 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-efc508a3-b23b-4bcb-b50d-b8a7d605dd5d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:47.230021 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-efc508a3-b23b-4bcb-b50d-b8a7d605dd5d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:47.233481 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-efc508a3-b23b-4bcb-b50d-b8a7d605dd5d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1724 microversion: 2.20 time: 0.520456 Feb 20 20:06:47.235347 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 191/363] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:46 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1724 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:47.433019 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-09d9b896-c2bd-4554-89d1-a0729e0855bb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:47.446732 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-09d9b896-c2bd-4554-89d1-a0729e0855bb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1568 microversion: 2.1 time: 0.586303 Feb 20 20:06:47.448104 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 173/364] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:46 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1568 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:47.558641 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-1c9da623-619d-4173-a3df-7b57f6a62d4e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:47.559254 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-1c9da623-619d-4173-a3df-7b57f6a62d4e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:47.566476 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1c9da623-619d-4173-a3df-7b57f6a62d4e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:47.567068 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1c9da623-619d-4173-a3df-7b57f6a62d4e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:47.568044 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1c9da623-619d-4173-a3df-7b57f6a62d4e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:47.568569 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1c9da623-619d-4173-a3df-7b57f6a62d4e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:47.712605 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-f421ddde-f2ea-4d25-9a6c-a9ea3bb7996e req-c46db05d-0f44-4053-a62e-66ae0d1d98c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19d0359-a8b7-4b10-9423-86e7bc401f0b", "tag": "24ada99e-5acc-483e-9242-a2920061f997"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:06:47.717458 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:06:47.717458 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:06:47.735339 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-f421ddde-f2ea-4d25-9a6c-a9ea3bb7996e req-c46db05d-0f44-4053-a62e-66ae0d1d98c8 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:47.736769 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-f421ddde-f2ea-4d25-9a6c-a9ea3bb7996e req-c46db05d-0f44-4053-a62e-66ae0d1d98c8 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:47.755515 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-f421ddde-f2ea-4d25-9a6c-a9ea3bb7996e req-c46db05d-0f44-4053-a62e-66ae0d1d98c8 service nova] Creating event network-changed:24ada99e-5acc-483e-9242-a2920061f997 for instance e19d0359-a8b7-4b10-9423-86e7bc401f0b on hv-cinder-83008 Feb 20 20:06:47.762971 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-f421ddde-f2ea-4d25-9a6c-a9ea3bb7996e req-c46db05d-0f44-4053-a62e-66ae0d1d98c8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057174 Feb 20 20:06:47.764004 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 174/365] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:06:47.769617 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-173daf2f-a93c-4871-9c87-6b5f0eff8535 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:47.771550 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-173daf2f-a93c-4871-9c87-6b5f0eff8535 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:47.788178 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-173daf2f-a93c-4871-9c87-6b5f0eff8535 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:47.791317 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-173daf2f-a93c-4871-9c87-6b5f0eff8535 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:47.791317 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-173daf2f-a93c-4871-9c87-6b5f0eff8535 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:47.791317 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-173daf2f-a93c-4871-9c87-6b5f0eff8535 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:47.831816 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-1c9da623-619d-4173-a3df-7b57f6a62d4e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:47.861065 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-1c9da623-619d-4173-a3df-7b57f6a62d4e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1698 microversion: 2.1 time: 0.306287 Feb 20 20:06:47.861602 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 192/366] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:47 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1698 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:47.867006 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d493cef7-f2f3-4c4f-8515-1d87cfe681e6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:47.867855 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d493cef7-f2f3-4c4f-8515-1d87cfe681e6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:47.875225 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d493cef7-f2f3-4c4f-8515-1d87cfe681e6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:47.876144 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d493cef7-f2f3-4c4f-8515-1d87cfe681e6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:47.877195 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d493cef7-f2f3-4c4f-8515-1d87cfe681e6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:47.877826 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d493cef7-f2f3-4c4f-8515-1d87cfe681e6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:47.972512 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d493cef7-f2f3-4c4f-8515-1d87cfe681e6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:47.989489 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d493cef7-f2f3-4c4f-8515-1d87cfe681e6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1274 microversion: 2.1 time: 0.125476 Feb 20 20:06:47.991453 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 193/367] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:47 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1274 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:48.002070 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c14eb8cd-e8bf-4eac-81fe-8dabfed371b6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:06:48.015402 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c14eb8cd-e8bf-4eac-81fe-8dabfed371b6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:48.020485 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c14eb8cd-e8bf-4eac-81fe-8dabfed371b6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:48.041895 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-173daf2f-a93c-4871-9c87-6b5f0eff8535 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:48.050840 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-173daf2f-a93c-4871-9c87-6b5f0eff8535 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.285289 Feb 20 20:06:48.055910 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 175/368] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:47 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:48.139081 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c14eb8cd-e8bf-4eac-81fe-8dabfed371b6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Going to try to start instance {{(pid=117088) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 20 20:06:48.275825 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5bc54320-2c65-4707-8a26-43f993730d7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:48.276959 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5bc54320-2c65-4707-8a26-43f993730d7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:48.287533 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5bc54320-2c65-4707-8a26-43f993730d7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:48.288319 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5bc54320-2c65-4707-8a26-43f993730d7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:48.289777 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5bc54320-2c65-4707-8a26-43f993730d7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:48.290554 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5bc54320-2c65-4707-8a26-43f993730d7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:48.364968 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c14eb8cd-e8bf-4eac-81fe-8dabfed371b6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "POST /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6/action" status: 202 len: 0 microversion: 2.1 time: 0.371475 Feb 20 20:06:48.365698 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 194/369] 10.222.0.60 () {60 vars in 1277 bytes} [Sun Feb 20 20:06:47 2022] POST /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:06:48.378937 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4e25f92c-e5ef-4f1d-a87a-b854f4189bbc tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:48.380226 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4e25f92c-e5ef-4f1d-a87a-b854f4189bbc tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:48.391073 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4e25f92c-e5ef-4f1d-a87a-b854f4189bbc tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:48.391889 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4e25f92c-e5ef-4f1d-a87a-b854f4189bbc tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:48.393278 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4e25f92c-e5ef-4f1d-a87a-b854f4189bbc tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:48.396850 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4e25f92c-e5ef-4f1d-a87a-b854f4189bbc tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:48.495948 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5bc54320-2c65-4707-8a26-43f993730d7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:48.511325 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5bc54320-2c65-4707-8a26-43f993730d7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:48.515380 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5bc54320-2c65-4707-8a26-43f993730d7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:48.517682 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5bc54320-2c65-4707-8a26-43f993730d7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1724 microversion: 2.20 time: 0.248486 Feb 20 20:06:48.530584 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 176/370] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:48 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:06:48.530584 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e71da492-9244-48d9-a5c5-3f35c7b34c99 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:48.530584 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e71da492-9244-48d9-a5c5-3f35c7b34c99 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:48.538445 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e71da492-9244-48d9-a5c5-3f35c7b34c99 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:48.539221 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e71da492-9244-48d9-a5c5-3f35c7b34c99 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:48.540334 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e71da492-9244-48d9-a5c5-3f35c7b34c99 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:48.541355 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e71da492-9244-48d9-a5c5-3f35c7b34c99 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:48.598779 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4e25f92c-e5ef-4f1d-a87a-b854f4189bbc tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:48.608148 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4e25f92c-e5ef-4f1d-a87a-b854f4189bbc tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1707 microversion: 2.1 time: 0.237244 Feb 20 20:06:48.608743 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 195/371] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:48 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1707 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:48.763981 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e71da492-9244-48d9-a5c5-3f35c7b34c99 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:48.772676 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e71da492-9244-48d9-a5c5-3f35c7b34c99 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1568 microversion: 2.1 time: 0.250677 Feb 20 20:06:48.773508 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 177/372] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:48 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1568 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:49.017290 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-dcd63ff8-973e-4e75-87d2-8a2c9ac75eb2 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:49.018298 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-dcd63ff8-973e-4e75-87d2-8a2c9ac75eb2 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:49.026973 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dcd63ff8-973e-4e75-87d2-8a2c9ac75eb2 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:49.027420 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dcd63ff8-973e-4e75-87d2-8a2c9ac75eb2 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:49.029812 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dcd63ff8-973e-4e75-87d2-8a2c9ac75eb2 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:49.030039 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dcd63ff8-973e-4e75-87d2-8a2c9ac75eb2 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:49.071018 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-99bcf185-29de-4d36-9c76-d345ea9c411f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:49.071805 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-99bcf185-29de-4d36-9c76-d345ea9c411f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:49.083194 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-99bcf185-29de-4d36-9c76-d345ea9c411f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:49.083665 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-99bcf185-29de-4d36-9c76-d345ea9c411f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:49.084479 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-99bcf185-29de-4d36-9c76-d345ea9c411f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:49.084927 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-99bcf185-29de-4d36-9c76-d345ea9c411f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:49.105949 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-dcd63ff8-973e-4e75-87d2-8a2c9ac75eb2 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:49.113854 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-dcd63ff8-973e-4e75-87d2-8a2c9ac75eb2 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1274 microversion: 2.1 time: 0.103567 Feb 20 20:06:49.114755 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 196/373] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:49 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1274 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:49.303699 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-99bcf185-29de-4d36-9c76-d345ea9c411f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:49.312111 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-99bcf185-29de-4d36-9c76-d345ea9c411f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.246015 Feb 20 20:06:49.312790 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 178/374] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:49 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:49.545884 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-dfae3937-9259-4ba5-9b19-72260145eee8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:49.546659 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-dfae3937-9259-4ba5-9b19-72260145eee8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:49.554076 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dfae3937-9259-4ba5-9b19-72260145eee8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:49.554594 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dfae3937-9259-4ba5-9b19-72260145eee8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:49.555414 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dfae3937-9259-4ba5-9b19-72260145eee8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:49.555886 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dfae3937-9259-4ba5-9b19-72260145eee8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:49.640619 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-13f8c669-84fa-4e0e-9ee5-22372e27ce95 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:49.640619 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-13f8c669-84fa-4e0e-9ee5-22372e27ce95 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:49.647048 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-13f8c669-84fa-4e0e-9ee5-22372e27ce95 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:49.647526 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-13f8c669-84fa-4e0e-9ee5-22372e27ce95 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:49.648326 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-13f8c669-84fa-4e0e-9ee5-22372e27ce95 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:49.648758 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-13f8c669-84fa-4e0e-9ee5-22372e27ce95 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:49.755525 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-dfae3937-9259-4ba5-9b19-72260145eee8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:49.769798 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-dfae3937-9259-4ba5-9b19-72260145eee8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:49.772653 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-dfae3937-9259-4ba5-9b19-72260145eee8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:49.774635 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-dfae3937-9259-4ba5-9b19-72260145eee8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1724 microversion: 2.20 time: 0.233355 Feb 20 20:06:49.775416 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 197/375] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:49 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:49.794965 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9b42dbf0-c53e-446d-b6fe-e508bf744037 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:49.795573 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9b42dbf0-c53e-446d-b6fe-e508bf744037 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:49.802338 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9b42dbf0-c53e-446d-b6fe-e508bf744037 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:49.802781 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9b42dbf0-c53e-446d-b6fe-e508bf744037 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:49.804392 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9b42dbf0-c53e-446d-b6fe-e508bf744037 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:49.805589 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9b42dbf0-c53e-446d-b6fe-e508bf744037 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:49.851285 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-13f8c669-84fa-4e0e-9ee5-22372e27ce95 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:49.860992 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-13f8c669-84fa-4e0e-9ee5-22372e27ce95 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1707 microversion: 2.1 time: 0.225721 Feb 20 20:06:49.861753 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 179/376] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:49 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1707 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:49.989643 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9b42dbf0-c53e-446d-b6fe-e508bf744037 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:49.998880 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9b42dbf0-c53e-446d-b6fe-e508bf744037 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1568 microversion: 2.1 time: 0.207398 Feb 20 20:06:49.999483 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 198/377] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:49 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1568 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:50.140126 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-26a4667c-b0c0-4c44-ad52-e0a3715916a4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:50.141306 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-26a4667c-b0c0-4c44-ad52-e0a3715916a4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:50.150900 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-26a4667c-b0c0-4c44-ad52-e0a3715916a4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:50.151643 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-26a4667c-b0c0-4c44-ad52-e0a3715916a4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:50.153046 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-26a4667c-b0c0-4c44-ad52-e0a3715916a4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:50.154442 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-26a4667c-b0c0-4c44-ad52-e0a3715916a4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:50.231545 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-26a4667c-b0c0-4c44-ad52-e0a3715916a4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:50.242271 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-26a4667c-b0c0-4c44-ad52-e0a3715916a4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1274 microversion: 2.1 time: 0.106967 Feb 20 20:06:50.243258 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 180/378] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:50 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1274 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:50.343441 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0c1f39fb-85ad-4423-8123-6cab8c8bafc4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:50.344482 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-0c1f39fb-85ad-4423-8123-6cab8c8bafc4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:50.354190 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0c1f39fb-85ad-4423-8123-6cab8c8bafc4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:50.354939 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0c1f39fb-85ad-4423-8123-6cab8c8bafc4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:50.356285 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0c1f39fb-85ad-4423-8123-6cab8c8bafc4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:50.358735 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0c1f39fb-85ad-4423-8123-6cab8c8bafc4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:50.553593 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-fae30c25-b4c8-4676-8f59-2f8ba91a28b2 req-e37c188d-9294-443d-adf9-4f46f00844d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97", "name": "network-vif-unplugged", "status": "completed", "tag": "87a52ebd-35dd-4b56-8924-9578f176542c"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:06:50.555749 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:06:50.555749 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:06:50.565697 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-fae30c25-b4c8-4676-8f59-2f8ba91a28b2 req-e37c188d-9294-443d-adf9-4f46f00844d3 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:50.566134 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-fae30c25-b4c8-4676-8f59-2f8ba91a28b2 req-e37c188d-9294-443d-adf9-4f46f00844d3 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:50.590488 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-fae30c25-b4c8-4676-8f59-2f8ba91a28b2 req-e37c188d-9294-443d-adf9-4f46f00844d3 service nova] Creating event network-vif-unplugged:87a52ebd-35dd-4b56-8924-9578f176542c for instance d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 on hv-cinder-83008 Feb 20 20:06:50.601875 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-fae30c25-b4c8-4676-8f59-2f8ba91a28b2 req-e37c188d-9294-443d-adf9-4f46f00844d3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051873 Feb 20 20:06:50.609367 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 181/379] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:06:50.700933 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0c1f39fb-85ad-4423-8123-6cab8c8bafc4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:50.713040 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-0c1f39fb-85ad-4423-8123-6cab8c8bafc4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.375226 Feb 20 20:06:50.726379 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 199/380] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:50 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:50.799278 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-20128517-2678-4d3c-a1c2-cd346de5f7c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:50.800416 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-20128517-2678-4d3c-a1c2-cd346de5f7c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:50.811164 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-20128517-2678-4d3c-a1c2-cd346de5f7c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:50.811930 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-20128517-2678-4d3c-a1c2-cd346de5f7c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:50.813285 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-20128517-2678-4d3c-a1c2-cd346de5f7c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:50.814019 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-20128517-2678-4d3c-a1c2-cd346de5f7c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:50.885782 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f4a58f84-5cb0-4fc0-8e96-1dbe59f2182e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:50.886691 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f4a58f84-5cb0-4fc0-8e96-1dbe59f2182e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:50.906485 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f4a58f84-5cb0-4fc0-8e96-1dbe59f2182e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:50.908553 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f4a58f84-5cb0-4fc0-8e96-1dbe59f2182e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:50.910831 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f4a58f84-5cb0-4fc0-8e96-1dbe59f2182e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:50.912401 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f4a58f84-5cb0-4fc0-8e96-1dbe59f2182e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:51.476424 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-20128517-2678-4d3c-a1c2-cd346de5f7c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:51.481530 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f4a58f84-5cb0-4fc0-8e96-1dbe59f2182e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:51.500882 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-20128517-2678-4d3c-a1c2-cd346de5f7c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:51.503889 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-20128517-2678-4d3c-a1c2-cd346de5f7c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:51.504082 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f4a58f84-5cb0-4fc0-8e96-1dbe59f2182e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1707 microversion: 2.1 time: 0.622384 Feb 20 20:06:51.517163 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 200/381] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:50 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1707 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:51.517626 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-20128517-2678-4d3c-a1c2-cd346de5f7c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1724 microversion: 2.20 time: 0.720346 Feb 20 20:06:51.517626 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 182/382] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:50 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1724 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:51.535504 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3e440465-30dc-4ff6-95f1-25b4fe253b6b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:51.536607 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3e440465-30dc-4ff6-95f1-25b4fe253b6b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:51.536839 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-785811fd-0471-477e-9879-d2cf0ed6a3f0 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:51.537710 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-785811fd-0471-477e-9879-d2cf0ed6a3f0 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:51.557651 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-785811fd-0471-477e-9879-d2cf0ed6a3f0 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:51.558400 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-785811fd-0471-477e-9879-d2cf0ed6a3f0 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:51.560441 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-785811fd-0471-477e-9879-d2cf0ed6a3f0 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:51.561314 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3e440465-30dc-4ff6-95f1-25b4fe253b6b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:51.563850 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3e440465-30dc-4ff6-95f1-25b4fe253b6b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:51.565684 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3e440465-30dc-4ff6-95f1-25b4fe253b6b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:51.566944 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-785811fd-0471-477e-9879-d2cf0ed6a3f0 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:51.570705 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3e440465-30dc-4ff6-95f1-25b4fe253b6b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:51.723473 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3e440465-30dc-4ff6-95f1-25b4fe253b6b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:51.736395 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3e440465-30dc-4ff6-95f1-25b4fe253b6b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1272 microversion: 2.1 time: 0.217640 Feb 20 20:06:51.736395 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 183/383] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:51 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:51.747448 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-fb66b61c-1b27-4467-978e-550d45a66ab6 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:51.747448 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-fb66b61c-1b27-4467-978e-550d45a66ab6 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:51.759941 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fb66b61c-1b27-4467-978e-550d45a66ab6 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:51.762057 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fb66b61c-1b27-4467-978e-550d45a66ab6 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:51.768721 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fb66b61c-1b27-4467-978e-550d45a66ab6 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:51.769323 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fb66b61c-1b27-4467-978e-550d45a66ab6 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:51.860271 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-785811fd-0471-477e-9879-d2cf0ed6a3f0 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:51.868875 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-785811fd-0471-477e-9879-d2cf0ed6a3f0 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1568 microversion: 2.1 time: 0.360954 Feb 20 20:06:51.869495 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 201/384] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:51 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1568 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:52.109514 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-fb66b61c-1b27-4467-978e-550d45a66ab6 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:52.122806 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-fb66b61c-1b27-4467-978e-550d45a66ab6 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.382555 Feb 20 20:06:52.122806 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 184/385] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:51 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:52.545235 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-80a458e2-c8de-4d2b-9d23-461fe059892a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:52.547180 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-80a458e2-c8de-4d2b-9d23-461fe059892a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:52.558402 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-74181472-9b36-4cd7-9167-2fc64f184fe0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:52.558402 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-74181472-9b36-4cd7-9167-2fc64f184fe0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:52.571063 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-80a458e2-c8de-4d2b-9d23-461fe059892a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:52.572613 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-80a458e2-c8de-4d2b-9d23-461fe059892a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:52.574383 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-74181472-9b36-4cd7-9167-2fc64f184fe0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:52.575467 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-74181472-9b36-4cd7-9167-2fc64f184fe0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:52.577058 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-80a458e2-c8de-4d2b-9d23-461fe059892a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:52.583188 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-74181472-9b36-4cd7-9167-2fc64f184fe0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:52.583339 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-80a458e2-c8de-4d2b-9d23-461fe059892a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:52.583442 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-74181472-9b36-4cd7-9167-2fc64f184fe0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:53.010412 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-80a458e2-c8de-4d2b-9d23-461fe059892a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:53.025854 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-80a458e2-c8de-4d2b-9d23-461fe059892a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:53.030972 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-74181472-9b36-4cd7-9167-2fc64f184fe0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:53.037916 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-80a458e2-c8de-4d2b-9d23-461fe059892a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:53.039790 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-80a458e2-c8de-4d2b-9d23-461fe059892a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1724 microversion: 2.20 time: 0.500737 Feb 20 20:06:53.041712 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 185/386] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:52 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1724 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:53.045652 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-74181472-9b36-4cd7-9167-2fc64f184fe0 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1707 microversion: 2.1 time: 0.514127 Feb 20 20:06:53.059408 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 202/387] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:52 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1707 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:53.066901 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-bda5651b-1a38-4ce8-9b0c-c1d908b5e8b4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:53.067934 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-bda5651b-1a38-4ce8-9b0c-c1d908b5e8b4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:53.073281 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-986e7e9e-6e01-497c-90b7-848db9efa860 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:53.073844 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-986e7e9e-6e01-497c-90b7-848db9efa860 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:53.089748 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-986e7e9e-6e01-497c-90b7-848db9efa860 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:53.090733 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-986e7e9e-6e01-497c-90b7-848db9efa860 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:53.093880 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-986e7e9e-6e01-497c-90b7-848db9efa860 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:53.094557 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-986e7e9e-6e01-497c-90b7-848db9efa860 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:53.102032 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bda5651b-1a38-4ce8-9b0c-c1d908b5e8b4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:53.102836 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bda5651b-1a38-4ce8-9b0c-c1d908b5e8b4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:53.107491 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bda5651b-1a38-4ce8-9b0c-c1d908b5e8b4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:53.107491 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bda5651b-1a38-4ce8-9b0c-c1d908b5e8b4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:53.553251 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-986e7e9e-6e01-497c-90b7-848db9efa860 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:53.566806 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-986e7e9e-6e01-497c-90b7-848db9efa860 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1568 microversion: 2.1 time: 0.498408 Feb 20 20:06:53.577741 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 203/388] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:53 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1568 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:53.588962 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-be0f7be1-2968-4fd3-af75-23b4d499fde1 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:53.590823 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-bda5651b-1a38-4ce8-9b0c-c1d908b5e8b4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:53.591989 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-be0f7be1-2968-4fd3-af75-23b4d499fde1 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:53.611280 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-bda5651b-1a38-4ce8-9b0c-c1d908b5e8b4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1314 microversion: 2.1 time: 0.567880 Feb 20 20:06:53.624540 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-be0f7be1-2968-4fd3-af75-23b4d499fde1 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:53.624540 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-be0f7be1-2968-4fd3-af75-23b4d499fde1 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:53.625208 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-be0f7be1-2968-4fd3-af75-23b4d499fde1 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:53.625977 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-be0f7be1-2968-4fd3-af75-23b4d499fde1 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:53.630263 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 186/389] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:53 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:53.836884 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-be0f7be1-2968-4fd3-af75-23b4d499fde1 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:53.849173 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-be0f7be1-2968-4fd3-af75-23b4d499fde1 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.269630 Feb 20 20:06:53.850074 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 204/390] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:53 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:54.069158 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4e02441b-a8ba-4a2a-ba7d-c636038d7e82 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:54.073045 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4e02441b-a8ba-4a2a-ba7d-c636038d7e82 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:54.081524 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4e02441b-a8ba-4a2a-ba7d-c636038d7e82 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:54.082386 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4e02441b-a8ba-4a2a-ba7d-c636038d7e82 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:54.083547 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4e02441b-a8ba-4a2a-ba7d-c636038d7e82 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:54.084346 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4e02441b-a8ba-4a2a-ba7d-c636038d7e82 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:54.093251 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-753cc968-feab-4dc4-8249-ebf87bc572f8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:54.095211 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-753cc968-feab-4dc4-8249-ebf87bc572f8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:54.101999 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-753cc968-feab-4dc4-8249-ebf87bc572f8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:54.102726 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-753cc968-feab-4dc4-8249-ebf87bc572f8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:54.103785 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-753cc968-feab-4dc4-8249-ebf87bc572f8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:54.104371 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-753cc968-feab-4dc4-8249-ebf87bc572f8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:54.507066 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-753cc968-feab-4dc4-8249-ebf87bc572f8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:54.507066 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-753cc968-feab-4dc4-8249-ebf87bc572f8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:54.507516 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-753cc968-feab-4dc4-8249-ebf87bc572f8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:54.507737 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4e02441b-a8ba-4a2a-ba7d-c636038d7e82 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:54.508887 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-753cc968-feab-4dc4-8249-ebf87bc572f8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1727 microversion: 2.20 time: 0.425579 Feb 20 20:06:54.525196 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 205/391] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:54 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1727 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:54.525644 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4e02441b-a8ba-4a2a-ba7d-c636038d7e82 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1711 microversion: 2.1 time: 0.462440 Feb 20 20:06:54.531607 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 187/392] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:54 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1711 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:54.531955 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-63854930-7920-4039-b170-6bca4e3dd8a9 req-0da7d450-911a-467f-9899-4165edc4744d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daac6aee-3c43-42a7-ad5d-c24028e3ed27", "tag": "3ca3ecd0-c84f-4ba7-8184-68fb80a53152"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:06:54.533628 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:06:54.533628 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:06:54.542583 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-63854930-7920-4039-b170-6bca4e3dd8a9 req-0da7d450-911a-467f-9899-4165edc4744d service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:54.543130 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-63854930-7920-4039-b170-6bca4e3dd8a9 req-0da7d450-911a-467f-9899-4165edc4744d service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:54.554572 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2b46fb05-59fb-48ea-ac2f-0c18d80f7878 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61b58779-e073-42db-ad32-5641e521d41d"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:06:54.558359 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2b46fb05-59fb-48ea-ac2f-0c18d80f7878 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:54.558825 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-63854930-7920-4039-b170-6bca4e3dd8a9 req-0da7d450-911a-467f-9899-4165edc4744d service nova] Creating event network-changed:3ca3ecd0-c84f-4ba7-8184-68fb80a53152 for instance daac6aee-3c43-42a7-ad5d-c24028e3ed27 on hv-cinder-83008 Feb 20 20:06:54.565377 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-63854930-7920-4039-b170-6bca4e3dd8a9 req-0da7d450-911a-467f-9899-4165edc4744d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038366 Feb 20 20:06:54.566014 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 206/393] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:06:54.572433 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2b46fb05-59fb-48ea-ac2f-0c18d80f7878 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:54.573266 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2b46fb05-59fb-48ea-ac2f-0c18d80f7878 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:54.574377 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2b46fb05-59fb-48ea-ac2f-0c18d80f7878 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:54.575181 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2b46fb05-59fb-48ea-ac2f-0c18d80f7878 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:54.600331 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-55f055be-b31e-47dc-87c0-622fd6a780ef tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:54.601627 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-55f055be-b31e-47dc-87c0-622fd6a780ef tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:54.611583 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-55f055be-b31e-47dc-87c0-622fd6a780ef tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:54.612031 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-55f055be-b31e-47dc-87c0-622fd6a780ef tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:54.612916 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-55f055be-b31e-47dc-87c0-622fd6a780ef tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:54.614009 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-55f055be-b31e-47dc-87c0-622fd6a780ef tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:54.980243 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-55f055be-b31e-47dc-87c0-622fd6a780ef tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:54.990433 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-55f055be-b31e-47dc-87c0-622fd6a780ef tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1548 microversion: 2.1 time: 0.400277 Feb 20 20:06:54.991821 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 207/394] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:54 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1548 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:55.010192 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-beadd27e-3c94-4e6d-acd5-fd7a14db1d63 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:55.011919 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-beadd27e-3c94-4e6d-acd5-fd7a14db1d63 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:55.024604 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-beadd27e-3c94-4e6d-acd5-fd7a14db1d63 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:55.025863 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-beadd27e-3c94-4e6d-acd5-fd7a14db1d63 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:55.026968 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-beadd27e-3c94-4e6d-acd5-fd7a14db1d63 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:55.027499 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-beadd27e-3c94-4e6d-acd5-fd7a14db1d63 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:55.257883 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-beadd27e-3c94-4e6d-acd5-fd7a14db1d63 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:55.267367 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-beadd27e-3c94-4e6d-acd5-fd7a14db1d63 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1314 microversion: 2.1 time: 0.274159 Feb 20 20:06:55.277194 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 208/395] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:54 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:55.277194 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2a8d0a3b-0665-4cb7-becd-d234046db41d tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:55.277194 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2a8d0a3b-0665-4cb7-becd-d234046db41d tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:55.283528 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2a8d0a3b-0665-4cb7-becd-d234046db41d tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:55.283993 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2a8d0a3b-0665-4cb7-becd-d234046db41d tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:55.284843 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2a8d0a3b-0665-4cb7-becd-d234046db41d tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:55.285311 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2a8d0a3b-0665-4cb7-becd-d234046db41d tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:55.498051 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2a8d0a3b-0665-4cb7-becd-d234046db41d tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:55.505993 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2a8d0a3b-0665-4cb7-becd-d234046db41d tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.236366 Feb 20 20:06:55.506853 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 209/396] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:55 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:55.521236 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e554dc6a-0a63-45f1-8852-7147b8827eb6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:55.521740 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e554dc6a-0a63-45f1-8852-7147b8827eb6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:55.529786 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e554dc6a-0a63-45f1-8852-7147b8827eb6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:55.530541 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e554dc6a-0a63-45f1-8852-7147b8827eb6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:55.531466 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e554dc6a-0a63-45f1-8852-7147b8827eb6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:55.531959 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e554dc6a-0a63-45f1-8852-7147b8827eb6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:55.707565 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-e554dc6a-0a63-45f1-8852-7147b8827eb6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] HTTP exception thrown: Cannot 'detach_volume' instance 6e394c2c-f9ca-4e79-9a43-f6a04f887f71 while it is in vm_state rescued Feb 20 20:06:55.708627 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e554dc6a-0a63-45f1-8852-7147b8827eb6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Returning 409 to user: Cannot 'detach_volume' instance 6e394c2c-f9ca-4e79-9a43-f6a04f887f71 while it is in vm_state rescued {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:06:55.708994 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e554dc6a-0a63-45f1-8852-7147b8827eb6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments/8c0e4c21-7eec-4805-9a91-7f8688a39734" status: 409 len: 152 microversion: 2.1 time: 0.201228 Feb 20 20:06:55.709678 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 210/397] 10.222.0.60 () {58 vars in 1415 bytes} [Sun Feb 20 20:06:55 2022] DELETE /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments/8c0e4c21-7eec-4805-9a91-7f8688a39734 => generated 152 bytes in 202 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 20 20:06:55.721317 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2df378b1-3855-4989-9cc9-075d30d11cc3 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:06:55.721846 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2df378b1-3855-4989-9cc9-075d30d11cc3 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:55.729063 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2df378b1-3855-4989-9cc9-075d30d11cc3 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:55.729542 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2df378b1-3855-4989-9cc9-075d30d11cc3 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:55.730330 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2df378b1-3855-4989-9cc9-075d30d11cc3 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:55.730758 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2df378b1-3855-4989-9cc9-075d30d11cc3 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:55.944078 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2b46fb05-59fb-48ea-ac2f-0c18d80f7878 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "POST /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.400638 Feb 20 20:06:55.945416 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 188/398] 10.222.0.60 () {62 vars in 1363 bytes} [Sun Feb 20 20:06:54 2022] POST /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-volume_attachments => generated 188 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 20 20:06:55.962628 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2df378b1-3855-4989-9cc9-075d30d11cc3 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "POST /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/action" status: 202 len: 0 microversion: 2.1 time: 0.243337 Feb 20 20:06:55.964046 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 211/399] 10.222.0.60 () {60 vars in 1277 bytes} [Sun Feb 20 20:06:55 2022] POST /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:06:55.981144 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-74d38b97-0f8c-488a-ad11-4b056a51669a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:55.982974 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-74d38b97-0f8c-488a-ad11-4b056a51669a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:55.993472 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-74d38b97-0f8c-488a-ad11-4b056a51669a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:55.994780 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-74d38b97-0f8c-488a-ad11-4b056a51669a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:55.996344 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-74d38b97-0f8c-488a-ad11-4b056a51669a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:55.998121 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-74d38b97-0f8c-488a-ad11-4b056a51669a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:56.122556 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ecaf1e84-7c4e-46ec-b9ff-170ce68c04dc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:06:56.123226 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ecaf1e84-7c4e-46ec-b9ff-170ce68c04dc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:56.130262 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ecaf1e84-7c4e-46ec-b9ff-170ce68c04dc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:56.130791 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ecaf1e84-7c4e-46ec-b9ff-170ce68c04dc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:56.131651 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ecaf1e84-7c4e-46ec-b9ff-170ce68c04dc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:56.132300 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ecaf1e84-7c4e-46ec-b9ff-170ce68c04dc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:56.270248 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-74d38b97-0f8c-488a-ad11-4b056a51669a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:56.284629 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-74d38b97-0f8c-488a-ad11-4b056a51669a tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1556 microversion: 2.1 time: 0.313633 Feb 20 20:06:56.285951 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 189/400] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:55 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1556 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:56.296604 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-bcf2653e-ac0a-4c68-862d-e2484626c88f tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:56.298396 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-bcf2653e-ac0a-4c68-862d-e2484626c88f tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:56.307600 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bcf2653e-ac0a-4c68-862d-e2484626c88f tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:56.308338 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bcf2653e-ac0a-4c68-862d-e2484626c88f tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:56.309543 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bcf2653e-ac0a-4c68-862d-e2484626c88f tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:56.310014 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bcf2653e-ac0a-4c68-862d-e2484626c88f tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:56.492491 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ecaf1e84-7c4e-46ec-b9ff-170ce68c04dc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "POST /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/action" status: 202 len: 0 microversion: 2.20 time: 0.375300 Feb 20 20:06:56.493978 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 212/401] 10.222.0.60 () {62 vars in 1318 bytes} [Sun Feb 20 20:06:56 2022] POST /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 20 20:06:56.509061 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5adb7539-2a8b-4708-914b-e6307ecc6d1e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:56.509961 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5adb7539-2a8b-4708-914b-e6307ecc6d1e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:56.520073 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5adb7539-2a8b-4708-914b-e6307ecc6d1e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:56.521066 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5adb7539-2a8b-4708-914b-e6307ecc6d1e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:56.522658 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5adb7539-2a8b-4708-914b-e6307ecc6d1e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:56.523658 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5adb7539-2a8b-4708-914b-e6307ecc6d1e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:56.631215 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-bcf2653e-ac0a-4c68-862d-e2484626c88f tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:56.638956 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-bcf2653e-ac0a-4c68-862d-e2484626c88f tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1314 microversion: 2.1 time: 0.351351 Feb 20 20:06:56.639541 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 190/402] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:56 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:56.646224 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4b6c95e7-6d87-4d76-acb1-de5d118b5c1b tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:56.646224 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4b6c95e7-6d87-4d76-acb1-de5d118b5c1b tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:56.662461 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4b6c95e7-6d87-4d76-acb1-de5d118b5c1b tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:56.662917 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4b6c95e7-6d87-4d76-acb1-de5d118b5c1b tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:56.669893 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4b6c95e7-6d87-4d76-acb1-de5d118b5c1b tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:56.669893 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4b6c95e7-6d87-4d76-acb1-de5d118b5c1b tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:57.009684 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5adb7539-2a8b-4708-914b-e6307ecc6d1e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:57.027067 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5adb7539-2a8b-4708-914b-e6307ecc6d1e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:57.030041 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5adb7539-2a8b-4708-914b-e6307ecc6d1e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:57.031770 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5adb7539-2a8b-4708-914b-e6307ecc6d1e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1753 microversion: 2.20 time: 0.528438 Feb 20 20:06:57.032852 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 213/403] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:56 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1753 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:06:57.063517 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4b6c95e7-6d87-4d76-acb1-de5d118b5c1b tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:57.073442 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4b6c95e7-6d87-4d76-acb1-de5d118b5c1b tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.432801 Feb 20 20:06:57.083437 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 191/404] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:56 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:57.305061 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-28bbaf9b-fedc-4c97-8d05-30ca4c7a97ca tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:57.306085 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-28bbaf9b-fedc-4c97-8d05-30ca4c7a97ca tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:57.316427 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-28bbaf9b-fedc-4c97-8d05-30ca4c7a97ca tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:57.317267 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-28bbaf9b-fedc-4c97-8d05-30ca4c7a97ca tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:57.318204 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-28bbaf9b-fedc-4c97-8d05-30ca4c7a97ca tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:57.318642 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-28bbaf9b-fedc-4c97-8d05-30ca4c7a97ca tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:57.485258 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-28bbaf9b-fedc-4c97-8d05-30ca4c7a97ca tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:57.500033 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-28bbaf9b-fedc-4c97-8d05-30ca4c7a97ca tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1556 microversion: 2.1 time: 0.198210 Feb 20 20:06:57.500997 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 214/405] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:57 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1556 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:57.662096 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e34d08de-ca8e-429a-8564-00178b3c750b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:57.662096 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e34d08de-ca8e-429a-8564-00178b3c750b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:57.668158 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e34d08de-ca8e-429a-8564-00178b3c750b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:57.668598 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e34d08de-ca8e-429a-8564-00178b3c750b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:57.669952 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e34d08de-ca8e-429a-8564-00178b3c750b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:57.670378 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e34d08de-ca8e-429a-8564-00178b3c750b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:57.870466 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e34d08de-ca8e-429a-8564-00178b3c750b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:57.896370 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e34d08de-ca8e-429a-8564-00178b3c750b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1314 microversion: 2.1 time: 0.239251 Feb 20 20:06:57.897934 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 192/406] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:57 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:58.065862 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-738d05dd-b288-49e2-92f6-edadfce26f54 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:58.066949 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-738d05dd-b288-49e2-92f6-edadfce26f54 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:58.077219 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-738d05dd-b288-49e2-92f6-edadfce26f54 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:58.077745 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-738d05dd-b288-49e2-92f6-edadfce26f54 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:58.078561 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-738d05dd-b288-49e2-92f6-edadfce26f54 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:58.079178 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-738d05dd-b288-49e2-92f6-edadfce26f54 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:58.095102 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-014b42e9-27c7-47f6-a3e3-35616b37eeda tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:58.096107 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-014b42e9-27c7-47f6-a3e3-35616b37eeda tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:58.105549 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-014b42e9-27c7-47f6-a3e3-35616b37eeda tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:58.106355 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-014b42e9-27c7-47f6-a3e3-35616b37eeda tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:58.107424 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-014b42e9-27c7-47f6-a3e3-35616b37eeda tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:58.108157 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-014b42e9-27c7-47f6-a3e3-35616b37eeda tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:58.312764 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-738d05dd-b288-49e2-92f6-edadfce26f54 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:58.324200 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-738d05dd-b288-49e2-92f6-edadfce26f54 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:58.327571 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-738d05dd-b288-49e2-92f6-edadfce26f54 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:58.328674 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-738d05dd-b288-49e2-92f6-edadfce26f54 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1753 microversion: 2.20 time: 0.281312 Feb 20 20:06:58.329441 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 215/407] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:58 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1753 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:06:58.351252 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-014b42e9-27c7-47f6-a3e3-35616b37eeda tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:58.359087 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-014b42e9-27c7-47f6-a3e3-35616b37eeda tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.271247 Feb 20 20:06:58.359672 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 193/408] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:58 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:58.519528 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-56bd2c2d-963c-4482-99b3-1534fdb5b2a6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:58.523665 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-56bd2c2d-963c-4482-99b3-1534fdb5b2a6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:58.526775 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-56bd2c2d-963c-4482-99b3-1534fdb5b2a6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:58.527511 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-56bd2c2d-963c-4482-99b3-1534fdb5b2a6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:58.528002 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-56bd2c2d-963c-4482-99b3-1534fdb5b2a6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:58.528489 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-56bd2c2d-963c-4482-99b3-1534fdb5b2a6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:58.681767 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-56bd2c2d-963c-4482-99b3-1534fdb5b2a6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:58.691520 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-56bd2c2d-963c-4482-99b3-1534fdb5b2a6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1556 microversion: 2.1 time: 0.175771 Feb 20 20:06:58.697144 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 216/409] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:58 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:58.925196 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b3ac03a7-05d1-4d85-a161-608504c7f41c tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:58.925829 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b3ac03a7-05d1-4d85-a161-608504c7f41c tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:58.933402 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b3ac03a7-05d1-4d85-a161-608504c7f41c tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:58.933854 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b3ac03a7-05d1-4d85-a161-608504c7f41c tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:58.935304 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b3ac03a7-05d1-4d85-a161-608504c7f41c tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:58.935747 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b3ac03a7-05d1-4d85-a161-608504c7f41c tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:59.096549 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b3ac03a7-05d1-4d85-a161-608504c7f41c tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:59.104436 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b3ac03a7-05d1-4d85-a161-608504c7f41c tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1314 microversion: 2.1 time: 0.184256 Feb 20 20:06:59.105003 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 194/410] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:58 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:06:59.348206 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c57a3cb4-6894-4e3d-811b-698372dc1f30 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:59.348798 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c57a3cb4-6894-4e3d-811b-698372dc1f30 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:59.355247 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c57a3cb4-6894-4e3d-811b-698372dc1f30 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:59.355690 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c57a3cb4-6894-4e3d-811b-698372dc1f30 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:59.357038 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c57a3cb4-6894-4e3d-811b-698372dc1f30 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:59.357641 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c57a3cb4-6894-4e3d-811b-698372dc1f30 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:59.378308 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b0e09550-ce0b-497c-b21e-da5eb5a67785 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:59.379398 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b0e09550-ce0b-497c-b21e-da5eb5a67785 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:59.386355 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b0e09550-ce0b-497c-b21e-da5eb5a67785 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:59.392353 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b0e09550-ce0b-497c-b21e-da5eb5a67785 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:59.392353 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b0e09550-ce0b-497c-b21e-da5eb5a67785 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:59.392353 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b0e09550-ce0b-497c-b21e-da5eb5a67785 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:59.639358 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c57a3cb4-6894-4e3d-811b-698372dc1f30 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:59.646571 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b0e09550-ce0b-497c-b21e-da5eb5a67785 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:59.653764 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c57a3cb4-6894-4e3d-811b-698372dc1f30 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:59.657937 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c57a3cb4-6894-4e3d-811b-698372dc1f30 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:59.669867 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c57a3cb4-6894-4e3d-811b-698372dc1f30 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1753 microversion: 2.20 time: 0.315364 Feb 20 20:06:59.669867 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 217/411] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:06:59 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1753 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:06:59.670214 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b0e09550-ce0b-497c-b21e-da5eb5a67785 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.288565 Feb 20 20:06:59.670214 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 195/412] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:59 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:06:59.717975 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8a4e7748-e30d-4fdf-8966-fdc49f90076f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:06:59.718592 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8a4e7748-e30d-4fdf-8966-fdc49f90076f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:06:59.725450 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8a4e7748-e30d-4fdf-8966-fdc49f90076f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:59.725901 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8a4e7748-e30d-4fdf-8966-fdc49f90076f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:59.726695 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8a4e7748-e30d-4fdf-8966-fdc49f90076f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:06:59.727130 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8a4e7748-e30d-4fdf-8966-fdc49f90076f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:06:59.938313 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8a4e7748-e30d-4fdf-8966-fdc49f90076f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:06:59.947052 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8a4e7748-e30d-4fdf-8966-fdc49f90076f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1556 microversion: 2.1 time: 0.233848 Feb 20 20:06:59.947657 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 218/413] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:06:59 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1556 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:07:00.123776 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f75212b8-75df-40dd-867c-cf6c4bc98ab1 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:00.124571 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f75212b8-75df-40dd-867c-cf6c4bc98ab1 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:00.132028 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f75212b8-75df-40dd-867c-cf6c4bc98ab1 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:00.132473 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f75212b8-75df-40dd-867c-cf6c4bc98ab1 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:00.133333 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f75212b8-75df-40dd-867c-cf6c4bc98ab1 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:00.133834 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f75212b8-75df-40dd-867c-cf6c4bc98ab1 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:00.303417 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f75212b8-75df-40dd-867c-cf6c4bc98ab1 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:00.313955 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f75212b8-75df-40dd-867c-cf6c4bc98ab1 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1314 microversion: 2.1 time: 0.194563 Feb 20 20:07:00.314536 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 196/414] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:00 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:00.678827 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-cebbfcb3-0bbb-4e3d-94c2-16175401a746 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:00.679810 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-cebbfcb3-0bbb-4e3d-94c2-16175401a746 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:00.688593 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cebbfcb3-0bbb-4e3d-94c2-16175401a746 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:00.689040 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cebbfcb3-0bbb-4e3d-94c2-16175401a746 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:00.690005 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cebbfcb3-0bbb-4e3d-94c2-16175401a746 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:00.690451 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cebbfcb3-0bbb-4e3d-94c2-16175401a746 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:00.692780 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4b45ff90-80f3-4351-883a-cc368c2255d5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:00.693819 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4b45ff90-80f3-4351-883a-cc368c2255d5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:00.700452 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4b45ff90-80f3-4351-883a-cc368c2255d5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:00.700898 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4b45ff90-80f3-4351-883a-cc368c2255d5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:00.701875 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4b45ff90-80f3-4351-883a-cc368c2255d5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:00.702300 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4b45ff90-80f3-4351-883a-cc368c2255d5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:00.959080 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-cebbfcb3-0bbb-4e3d-94c2-16175401a746 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:00.972263 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-cebbfcb3-0bbb-4e3d-94c2-16175401a746 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.296553 Feb 20 20:07:00.981524 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 219/415] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:00 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:07:00.986237 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4b45ff90-80f3-4351-883a-cc368c2255d5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:00.986499 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bc0b04db-4db1-4544-8989-9832aea6cf82 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:00.987225 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-bc0b04db-4db1-4544-8989-9832aea6cf82 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:00.994777 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bc0b04db-4db1-4544-8989-9832aea6cf82 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:00.995388 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bc0b04db-4db1-4544-8989-9832aea6cf82 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:00.996285 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bc0b04db-4db1-4544-8989-9832aea6cf82 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:00.996800 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bc0b04db-4db1-4544-8989-9832aea6cf82 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:01.001825 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4b45ff90-80f3-4351-883a-cc368c2255d5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:01.004742 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4b45ff90-80f3-4351-883a-cc368c2255d5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:01.007081 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4b45ff90-80f3-4351-883a-cc368c2255d5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1753 microversion: 2.20 time: 0.320408 Feb 20 20:07:01.008095 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 197/416] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:00 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1753 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:07:01.163933 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-bc0b04db-4db1-4544-8989-9832aea6cf82 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:01.172704 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-bc0b04db-4db1-4544-8989-9832aea6cf82 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1556 microversion: 2.1 time: 0.189957 Feb 20 20:07:01.174268 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 220/417] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:00 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1556 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:01.335074 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3f69d5be-6a4a-47af-80b0-b16a8b29e55c tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:01.335782 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3f69d5be-6a4a-47af-80b0-b16a8b29e55c tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:01.342929 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3f69d5be-6a4a-47af-80b0-b16a8b29e55c tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:01.343374 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3f69d5be-6a4a-47af-80b0-b16a8b29e55c tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:01.344176 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3f69d5be-6a4a-47af-80b0-b16a8b29e55c tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:01.344595 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3f69d5be-6a4a-47af-80b0-b16a8b29e55c tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:01.751738 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3f69d5be-6a4a-47af-80b0-b16a8b29e55c tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:01.759481 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3f69d5be-6a4a-47af-80b0-b16a8b29e55c tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1314 microversion: 2.1 time: 0.428309 Feb 20 20:07:01.760110 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 198/418] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:01 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:01.991945 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f947b1d4-109c-485a-a0c6-982fc8d30688 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:01.993964 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f947b1d4-109c-485a-a0c6-982fc8d30688 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:02.009137 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f947b1d4-109c-485a-a0c6-982fc8d30688 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:02.009137 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f947b1d4-109c-485a-a0c6-982fc8d30688 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:02.009137 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f947b1d4-109c-485a-a0c6-982fc8d30688 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:02.009137 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f947b1d4-109c-485a-a0c6-982fc8d30688 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:02.029600 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-71032db4-b626-49a0-8a4a-4aba9b232bb3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:02.030748 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-71032db4-b626-49a0-8a4a-4aba9b232bb3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:02.038235 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-71032db4-b626-49a0-8a4a-4aba9b232bb3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:02.038942 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-71032db4-b626-49a0-8a4a-4aba9b232bb3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:02.043786 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-71032db4-b626-49a0-8a4a-4aba9b232bb3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:02.043786 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-71032db4-b626-49a0-8a4a-4aba9b232bb3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:02.272929 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f947b1d4-109c-485a-a0c6-982fc8d30688 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:02.279331 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f947b1d4-109c-485a-a0c6-982fc8d30688 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.293251 Feb 20 20:07:02.280147 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 221/419] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:01 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:02.282952 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-71032db4-b626-49a0-8a4a-4aba9b232bb3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:02.288275 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0fa4c3d1-f9f2-415e-be5a-b9f9ba5d5d40 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:02.289687 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-0fa4c3d1-f9f2-415e-be5a-b9f9ba5d5d40 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:02.292479 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-71032db4-b626-49a0-8a4a-4aba9b232bb3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:02.294739 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-71032db4-b626-49a0-8a4a-4aba9b232bb3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:02.296055 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-71032db4-b626-49a0-8a4a-4aba9b232bb3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1755 microversion: 2.20 time: 0.272086 Feb 20 20:07:02.296628 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 199/420] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:02 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1755 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:07:02.300046 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0fa4c3d1-f9f2-415e-be5a-b9f9ba5d5d40 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:02.300497 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0fa4c3d1-f9f2-415e-be5a-b9f9ba5d5d40 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:02.301318 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0fa4c3d1-f9f2-415e-be5a-b9f9ba5d5d40 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:02.301769 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0fa4c3d1-f9f2-415e-be5a-b9f9ba5d5d40 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:02.521836 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0fa4c3d1-f9f2-415e-be5a-b9f9ba5d5d40 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:02.538802 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-0fa4c3d1-f9f2-415e-be5a-b9f9ba5d5d40 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1562 microversion: 2.1 time: 0.252759 Feb 20 20:07:02.538802 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 222/421] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:02 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1562 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:02.621602 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e4c49d1d-62f0-474c-b1a5-998fc3bc61da tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:02.622868 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e4c49d1d-62f0-474c-b1a5-998fc3bc61da tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:02.629144 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e4c49d1d-62f0-474c-b1a5-998fc3bc61da tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:02.629592 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e4c49d1d-62f0-474c-b1a5-998fc3bc61da tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:02.630385 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e4c49d1d-62f0-474c-b1a5-998fc3bc61da tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:02.630814 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e4c49d1d-62f0-474c-b1a5-998fc3bc61da tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:02.781423 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-dfd8a5d1-f372-4e10-88fc-28f2fb61ab25 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:02.781918 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-dfd8a5d1-f372-4e10-88fc-28f2fb61ab25 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:02.788203 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dfd8a5d1-f372-4e10-88fc-28f2fb61ab25 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:02.788651 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dfd8a5d1-f372-4e10-88fc-28f2fb61ab25 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:02.789524 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dfd8a5d1-f372-4e10-88fc-28f2fb61ab25 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:02.789901 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dfd8a5d1-f372-4e10-88fc-28f2fb61ab25 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:02.946852 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-e4c49d1d-62f0-474c-b1a5-998fc3bc61da tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lazy-loading 'services' on Instance uuid 6e394c2c-f9ca-4e79-9a43-f6a04f887f71 {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:07:02.961772 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-dfd8a5d1-f372-4e10-88fc-28f2fb61ab25 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:02.970723 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-dfd8a5d1-f372-4e10-88fc-28f2fb61ab25 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1314 microversion: 2.1 time: 0.194090 Feb 20 20:07:02.971426 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 223/422] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:02 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:07:03.287416 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e4c49d1d-62f0-474c-b1a5-998fc3bc61da tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments/8c0e4c21-7eec-4805-9a91-7f8688a39734" status: 202 len: 0 microversion: 2.1 time: 0.671822 Feb 20 20:07:03.288477 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 200/423] 10.222.0.60 () {58 vars in 1415 bytes} [Sun Feb 20 20:07:02 2022] DELETE /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments/8c0e4c21-7eec-4805-9a91-7f8688a39734 => generated 0 bytes in 675 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:07:03.301060 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-db6fa4ee-b615-4d48-b416-d41f17486333 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:03.303880 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-db6fa4ee-b615-4d48-b416-d41f17486333 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:03.311356 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b93c541b-d3e9-403e-9949-4b2f9858b41d tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:03.312887 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b93c541b-d3e9-403e-9949-4b2f9858b41d tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:03.314861 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-db6fa4ee-b615-4d48-b416-d41f17486333 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:03.317739 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-db6fa4ee-b615-4d48-b416-d41f17486333 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:03.317739 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-db6fa4ee-b615-4d48-b416-d41f17486333 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:03.317739 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-db6fa4ee-b615-4d48-b416-d41f17486333 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:03.322453 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b93c541b-d3e9-403e-9949-4b2f9858b41d tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:03.322879 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b93c541b-d3e9-403e-9949-4b2f9858b41d tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:03.323665 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b93c541b-d3e9-403e-9949-4b2f9858b41d tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:03.329941 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b93c541b-d3e9-403e-9949-4b2f9858b41d tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:03.361417 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-db6fa4ee-b615-4d48-b416-d41f17486333 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067755 Feb 20 20:07:03.362904 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 224/424] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:07:03 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:07:03.368240 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-59f75830-e160-4afa-97a6-de653f402e09 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:03.369170 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-59f75830-e160-4afa-97a6-de653f402e09 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:03.376655 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-59f75830-e160-4afa-97a6-de653f402e09 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:03.377218 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-59f75830-e160-4afa-97a6-de653f402e09 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:03.378293 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-59f75830-e160-4afa-97a6-de653f402e09 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:03.378806 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-59f75830-e160-4afa-97a6-de653f402e09 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:03.634212 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b93c541b-d3e9-403e-9949-4b2f9858b41d tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:03.658454 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b93c541b-d3e9-403e-9949-4b2f9858b41d tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.357418 Feb 20 20:07:03.660069 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 201/425] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:03 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:03.695531 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-59f75830-e160-4afa-97a6-de653f402e09 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:03.704421 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-b64dc649-a8fb-4222-adec-a508bf34b622 req-1fb8c02a-9789-4a4e-bf7c-ec8487ef0cac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daac6aee-3c43-42a7-ad5d-c24028e3ed27", "name": "network-vif-plugged", "status": "completed", "tag": "3ca3ecd0-c84f-4ba7-8184-68fb80a53152"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:07:03.709630 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:07:03.709630 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:07:03.718874 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-b64dc649-a8fb-4222-adec-a508bf34b622 req-1fb8c02a-9789-4a4e-bf7c-ec8487ef0cac service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:03.719677 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-b64dc649-a8fb-4222-adec-a508bf34b622 req-1fb8c02a-9789-4a4e-bf7c-ec8487ef0cac service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:03.721203 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-59f75830-e160-4afa-97a6-de653f402e09 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:03.724069 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-59f75830-e160-4afa-97a6-de653f402e09 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:03.726130 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-59f75830-e160-4afa-97a6-de653f402e09 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.361629 Feb 20 20:07:03.727078 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 225/426] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:03 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:07:03.733473 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-b64dc649-a8fb-4222-adec-a508bf34b622 req-1fb8c02a-9789-4a4e-bf7c-ec8487ef0cac service nova] Creating event network-vif-plugged:3ca3ecd0-c84f-4ba7-8184-68fb80a53152 for instance daac6aee-3c43-42a7-ad5d-c24028e3ed27 on hv-cinder-83008 Feb 20 20:07:03.742910 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-b64dc649-a8fb-4222-adec-a508bf34b622 req-1fb8c02a-9789-4a4e-bf7c-ec8487ef0cac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043482 Feb 20 20:07:03.744128 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 202/427] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:07:03.989030 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-487e9f69-8a65-4703-a851-60ba7919b945 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:03.990022 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-487e9f69-8a65-4703-a851-60ba7919b945 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:03.996573 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-487e9f69-8a65-4703-a851-60ba7919b945 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:03.997693 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-487e9f69-8a65-4703-a851-60ba7919b945 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:03.998609 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-487e9f69-8a65-4703-a851-60ba7919b945 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:03.999084 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-487e9f69-8a65-4703-a851-60ba7919b945 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:04.175624 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-487e9f69-8a65-4703-a851-60ba7919b945 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:04.189170 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-487e9f69-8a65-4703-a851-60ba7919b945 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1314 microversion: 2.1 time: 0.203637 Feb 20 20:07:04.189981 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 226/428] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:03 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:04.377322 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-caa14f39-7ebd-4c74-b04a-4b6a3dbfe33d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:04.378242 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-caa14f39-7ebd-4c74-b04a-4b6a3dbfe33d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:04.384849 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-caa14f39-7ebd-4c74-b04a-4b6a3dbfe33d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:04.385359 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-caa14f39-7ebd-4c74-b04a-4b6a3dbfe33d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:04.386287 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-caa14f39-7ebd-4c74-b04a-4b6a3dbfe33d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:04.386637 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-caa14f39-7ebd-4c74-b04a-4b6a3dbfe33d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:04.420358 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-caa14f39-7ebd-4c74-b04a-4b6a3dbfe33d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047882 Feb 20 20:07:04.420947 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 203/429] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:07:04 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:07:04.678250 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ce3ba3e6-ea10-461b-9c86-3a862188d7ee tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:04.679137 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ce3ba3e6-ea10-461b-9c86-3a862188d7ee tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:04.690444 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ce3ba3e6-ea10-461b-9c86-3a862188d7ee tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:04.691232 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ce3ba3e6-ea10-461b-9c86-3a862188d7ee tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:04.692578 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ce3ba3e6-ea10-461b-9c86-3a862188d7ee tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:04.693338 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ce3ba3e6-ea10-461b-9c86-3a862188d7ee tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:04.748432 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-406d106d-c239-4f70-881b-4d6854aacd50 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:04.749283 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-406d106d-c239-4f70-881b-4d6854aacd50 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:04.756146 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-406d106d-c239-4f70-881b-4d6854aacd50 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:04.756682 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-406d106d-c239-4f70-881b-4d6854aacd50 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:04.757508 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-406d106d-c239-4f70-881b-4d6854aacd50 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:04.757936 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-406d106d-c239-4f70-881b-4d6854aacd50 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:04.905452 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ce3ba3e6-ea10-461b-9c86-3a862188d7ee tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:04.913846 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ce3ba3e6-ea10-461b-9c86-3a862188d7ee tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.240867 Feb 20 20:07:04.914547 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 227/430] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:04 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:04.986839 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-406d106d-c239-4f70-881b-4d6854aacd50 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:04.999770 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-406d106d-c239-4f70-881b-4d6854aacd50 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:05.002737 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-406d106d-c239-4f70-881b-4d6854aacd50 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:05.004274 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-406d106d-c239-4f70-881b-4d6854aacd50 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.260821 Feb 20 20:07:05.004862 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 204/431] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:04 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:07:05.207481 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ac8cc441-7952-4fef-a4f0-77f5050611f5 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:05.208185 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ac8cc441-7952-4fef-a4f0-77f5050611f5 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:05.215039 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ac8cc441-7952-4fef-a4f0-77f5050611f5 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:05.215493 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ac8cc441-7952-4fef-a4f0-77f5050611f5 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:05.217124 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ac8cc441-7952-4fef-a4f0-77f5050611f5 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:05.217726 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ac8cc441-7952-4fef-a4f0-77f5050611f5 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:05.386027 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ac8cc441-7952-4fef-a4f0-77f5050611f5 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:05.394532 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ac8cc441-7952-4fef-a4f0-77f5050611f5 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1314 microversion: 2.1 time: 0.190969 Feb 20 20:07:05.395125 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 228/432] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:05 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:05.436319 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6cd72c2d-2da0-4c67-8827-848dc512bc9d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:05.437881 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6cd72c2d-2da0-4c67-8827-848dc512bc9d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:05.448268 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6cd72c2d-2da0-4c67-8827-848dc512bc9d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:05.448969 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6cd72c2d-2da0-4c67-8827-848dc512bc9d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:05.450373 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6cd72c2d-2da0-4c67-8827-848dc512bc9d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:05.451354 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6cd72c2d-2da0-4c67-8827-848dc512bc9d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:05.507957 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6cd72c2d-2da0-4c67-8827-848dc512bc9d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078605 Feb 20 20:07:05.509009 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 205/433] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:07:05 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:07:05.940165 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-74d75bc1-87cf-42a6-9530-86f0969addf9 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:05.940820 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-74d75bc1-87cf-42a6-9530-86f0969addf9 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:05.948100 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-74d75bc1-87cf-42a6-9530-86f0969addf9 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:05.948563 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-74d75bc1-87cf-42a6-9530-86f0969addf9 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:05.949431 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-74d75bc1-87cf-42a6-9530-86f0969addf9 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:05.949884 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-74d75bc1-87cf-42a6-9530-86f0969addf9 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:06.023979 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ce1e528e-f9a0-45e4-aae2-5cb8096cfab3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:06.024580 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ce1e528e-f9a0-45e4-aae2-5cb8096cfab3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:06.032365 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ce1e528e-f9a0-45e4-aae2-5cb8096cfab3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:06.032818 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ce1e528e-f9a0-45e4-aae2-5cb8096cfab3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:06.033659 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ce1e528e-f9a0-45e4-aae2-5cb8096cfab3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:06.034099 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ce1e528e-f9a0-45e4-aae2-5cb8096cfab3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:06.127785 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-74d75bc1-87cf-42a6-9530-86f0969addf9 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:06.137813 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-74d75bc1-87cf-42a6-9530-86f0969addf9 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.203003 Feb 20 20:07:06.138467 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 229/434] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:05 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:06.227307 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ce1e528e-f9a0-45e4-aae2-5cb8096cfab3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:06.246226 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ce1e528e-f9a0-45e4-aae2-5cb8096cfab3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:06.249158 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ce1e528e-f9a0-45e4-aae2-5cb8096cfab3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:06.250745 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ce1e528e-f9a0-45e4-aae2-5cb8096cfab3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.230492 Feb 20 20:07:06.251423 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 206/435] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:06 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:07:06.416188 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-37464a34-1d83-49e7-9a7f-4cfe00550abd tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:06.416995 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-37464a34-1d83-49e7-9a7f-4cfe00550abd tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:06.428596 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-37464a34-1d83-49e7-9a7f-4cfe00550abd tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:06.429971 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-37464a34-1d83-49e7-9a7f-4cfe00550abd tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:06.431153 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-37464a34-1d83-49e7-9a7f-4cfe00550abd tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:06.432915 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-37464a34-1d83-49e7-9a7f-4cfe00550abd tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:06.531190 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ef42488c-a247-4ebf-a038-678f9a87f3fd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:06.531190 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ef42488c-a247-4ebf-a038-678f9a87f3fd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:06.545230 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ef42488c-a247-4ebf-a038-678f9a87f3fd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:06.546226 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ef42488c-a247-4ebf-a038-678f9a87f3fd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:06.547694 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ef42488c-a247-4ebf-a038-678f9a87f3fd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:06.548500 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ef42488c-a247-4ebf-a038-678f9a87f3fd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:06.612927 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ef42488c-a247-4ebf-a038-678f9a87f3fd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092527 Feb 20 20:07:06.614530 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 207/436] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:07:06 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:07:06.675661 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-37464a34-1d83-49e7-9a7f-4cfe00550abd tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:06.685930 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-37464a34-1d83-49e7-9a7f-4cfe00550abd tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1314 microversion: 2.1 time: 0.275920 Feb 20 20:07:06.686559 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 230/437] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:06 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:07.156001 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8e58687d-0cf5-413e-bb13-20a0c2525f30 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:07.156660 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8e58687d-0cf5-413e-bb13-20a0c2525f30 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:07.176558 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8e58687d-0cf5-413e-bb13-20a0c2525f30 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:07.176558 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8e58687d-0cf5-413e-bb13-20a0c2525f30 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:07.176558 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8e58687d-0cf5-413e-bb13-20a0c2525f30 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:07.176558 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8e58687d-0cf5-413e-bb13-20a0c2525f30 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:07.286113 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-1ee9c883-d6eb-4171-bfb5-2679ddfb7a5e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:07.288374 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-1ee9c883-d6eb-4171-bfb5-2679ddfb7a5e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:07.301033 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1ee9c883-d6eb-4171-bfb5-2679ddfb7a5e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:07.302245 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1ee9c883-d6eb-4171-bfb5-2679ddfb7a5e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:07.303829 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1ee9c883-d6eb-4171-bfb5-2679ddfb7a5e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:07.304941 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1ee9c883-d6eb-4171-bfb5-2679ddfb7a5e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:07.444880 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8e58687d-0cf5-413e-bb13-20a0c2525f30 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:07.454041 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8e58687d-0cf5-413e-bb13-20a0c2525f30 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.302877 Feb 20 20:07:07.456096 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 208/438] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:07 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:07:07.601340 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-1ee9c883-d6eb-4171-bfb5-2679ddfb7a5e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:07.611649 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-1ee9c883-d6eb-4171-bfb5-2679ddfb7a5e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:07.613227 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-1ee9c883-d6eb-4171-bfb5-2679ddfb7a5e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:07.614437 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-1ee9c883-d6eb-4171-bfb5-2679ddfb7a5e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.337511 Feb 20 20:07:07.615017 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 231/439] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:07 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:07:07.626615 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-22f9a4b6-d37f-43c3-b168-c6d02e3708dd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:07.627551 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-22f9a4b6-d37f-43c3-b168-c6d02e3708dd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:07.634250 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-22f9a4b6-d37f-43c3-b168-c6d02e3708dd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:07.634709 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-22f9a4b6-d37f-43c3-b168-c6d02e3708dd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:07.635614 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-22f9a4b6-d37f-43c3-b168-c6d02e3708dd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:07.635966 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-22f9a4b6-d37f-43c3-b168-c6d02e3708dd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:07.679482 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-22f9a4b6-d37f-43c3-b168-c6d02e3708dd tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057667 Feb 20 20:07:07.680176 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 209/440] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:07:07 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:07:07.704116 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9ebcf7d8-20b0-46b8-b061-b49ac1aca11d tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:07.704745 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9ebcf7d8-20b0-46b8-b061-b49ac1aca11d tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:07.711296 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9ebcf7d8-20b0-46b8-b061-b49ac1aca11d tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:07.713193 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9ebcf7d8-20b0-46b8-b061-b49ac1aca11d tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:07.713193 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9ebcf7d8-20b0-46b8-b061-b49ac1aca11d tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:07.713193 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9ebcf7d8-20b0-46b8-b061-b49ac1aca11d tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:07.965441 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9ebcf7d8-20b0-46b8-b061-b49ac1aca11d tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:07.976634 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9ebcf7d8-20b0-46b8-b061-b49ac1aca11d tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1314 microversion: 2.1 time: 0.276957 Feb 20 20:07:07.977655 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 232/441] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:07 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:08.479894 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2cb724c6-959b-4e79-b0d6-344192cd4230 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:08.482554 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2cb724c6-959b-4e79-b0d6-344192cd4230 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:08.490155 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2cb724c6-959b-4e79-b0d6-344192cd4230 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:08.490898 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2cb724c6-959b-4e79-b0d6-344192cd4230 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:08.491712 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2cb724c6-959b-4e79-b0d6-344192cd4230 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:08.492266 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2cb724c6-959b-4e79-b0d6-344192cd4230 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:08.609434 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-6e8b782c-077c-4892-8d4c-ca616f4571c7 req-8e0d4f50-b787-43b4-82a5-e85daf22f262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19d0359-a8b7-4b10-9423-86e7bc401f0b", "name": "network-vif-plugged", "status": "completed", "tag": "24ada99e-5acc-483e-9242-a2920061f997"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:07:08.611856 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:07:08.611856 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:07:08.633342 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-6e8b782c-077c-4892-8d4c-ca616f4571c7 req-8e0d4f50-b787-43b4-82a5-e85daf22f262 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:08.633822 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-6e8b782c-077c-4892-8d4c-ca616f4571c7 req-8e0d4f50-b787-43b4-82a5-e85daf22f262 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:08.646924 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-6e8b782c-077c-4892-8d4c-ca616f4571c7 req-8e0d4f50-b787-43b4-82a5-e85daf22f262 service nova] Creating event network-vif-plugged:24ada99e-5acc-483e-9242-a2920061f997 for instance e19d0359-a8b7-4b10-9423-86e7bc401f0b on hv-cinder-83008 Feb 20 20:07:08.652907 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-6e8b782c-077c-4892-8d4c-ca616f4571c7 req-8e0d4f50-b787-43b4-82a5-e85daf22f262 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064538 Feb 20 20:07:08.654473 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 233/442] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:07:08.660109 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9d769986-c9e0-4a43-8942-5e49440c5c7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:08.661397 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9d769986-c9e0-4a43-8942-5e49440c5c7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:08.669355 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9d769986-c9e0-4a43-8942-5e49440c5c7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:08.669968 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9d769986-c9e0-4a43-8942-5e49440c5c7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:08.671052 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9d769986-c9e0-4a43-8942-5e49440c5c7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:08.671501 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9d769986-c9e0-4a43-8942-5e49440c5c7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:08.724400 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2cb724c6-959b-4e79-b0d6-344192cd4230 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:08.742292 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2cb724c6-959b-4e79-b0d6-344192cd4230 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.273280 Feb 20 20:07:08.744896 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 210/443] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:08 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:08.758664 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2586e12e-aaed-4897-af02-44b72383ed9d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:08.759988 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2586e12e-aaed-4897-af02-44b72383ed9d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:08.768162 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2586e12e-aaed-4897-af02-44b72383ed9d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:08.768885 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2586e12e-aaed-4897-af02-44b72383ed9d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:08.769900 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2586e12e-aaed-4897-af02-44b72383ed9d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:08.770434 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2586e12e-aaed-4897-af02-44b72383ed9d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:08.819064 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2586e12e-aaed-4897-af02-44b72383ed9d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072747 Feb 20 20:07:08.824319 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 211/444] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:07:08 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:07:08.874011 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9d769986-c9e0-4a43-8942-5e49440c5c7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:08.882500 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9d769986-c9e0-4a43-8942-5e49440c5c7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:08.884344 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9d769986-c9e0-4a43-8942-5e49440c5c7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:08.885551 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9d769986-c9e0-4a43-8942-5e49440c5c7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.229701 Feb 20 20:07:08.886112 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 234/445] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:08 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:07:08.995670 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-255973c3-f66f-41ed-bc37-7d6bb7d92018 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:08.996352 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-255973c3-f66f-41ed-bc37-7d6bb7d92018 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:09.009898 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-255973c3-f66f-41ed-bc37-7d6bb7d92018 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:09.010429 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-255973c3-f66f-41ed-bc37-7d6bb7d92018 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:09.011301 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-255973c3-f66f-41ed-bc37-7d6bb7d92018 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:09.011804 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-255973c3-f66f-41ed-bc37-7d6bb7d92018 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:09.217327 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-255973c3-f66f-41ed-bc37-7d6bb7d92018 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:09.229459 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-255973c3-f66f-41ed-bc37-7d6bb7d92018 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1464 microversion: 2.1 time: 0.237164 Feb 20 20:07:09.244840 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 212/446] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:08 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1464 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:09.280114 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6e114d5f-a59d-47a9-a93d-8c0e24d2480c tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:09.281566 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6e114d5f-a59d-47a9-a93d-8c0e24d2480c tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:09.290436 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6e114d5f-a59d-47a9-a93d-8c0e24d2480c tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:09.291023 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6e114d5f-a59d-47a9-a93d-8c0e24d2480c tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:09.293673 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6e114d5f-a59d-47a9-a93d-8c0e24d2480c tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:09.293673 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6e114d5f-a59d-47a9-a93d-8c0e24d2480c tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:09.321874 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6e114d5f-a59d-47a9-a93d-8c0e24d2480c tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 20 20:07:09.600373 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6e114d5f-a59d-47a9-a93d-8c0e24d2480c tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "DELETE /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 204 len: 0 microversion: 2.1 time: 0.326368 Feb 20 20:07:09.601477 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 235/447] 10.222.0.60 () {58 vars in 1238 bytes} [Sun Feb 20 20:07:09 2022] DELETE /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 20 20:07:09.612920 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1e0e8b15-4334-4e77-90f8-2c6f0672dd63 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:09.613734 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1e0e8b15-4334-4e77-90f8-2c6f0672dd63 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:09.620623 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1e0e8b15-4334-4e77-90f8-2c6f0672dd63 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:09.621069 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1e0e8b15-4334-4e77-90f8-2c6f0672dd63 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:09.622437 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1e0e8b15-4334-4e77-90f8-2c6f0672dd63 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:09.622882 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1e0e8b15-4334-4e77-90f8-2c6f0672dd63 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:09.769954 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c543dd8b-fce7-45b5-9da6-57aedc024b2e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:09.770659 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c543dd8b-fce7-45b5-9da6-57aedc024b2e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:09.781191 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c543dd8b-fce7-45b5-9da6-57aedc024b2e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:09.781926 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c543dd8b-fce7-45b5-9da6-57aedc024b2e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:09.782899 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c543dd8b-fce7-45b5-9da6-57aedc024b2e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:09.784968 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c543dd8b-fce7-45b5-9da6-57aedc024b2e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:09.820374 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1e0e8b15-4334-4e77-90f8-2c6f0672dd63 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:09.830769 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1e0e8b15-4334-4e77-90f8-2c6f0672dd63 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1470 microversion: 2.1 time: 0.224623 Feb 20 20:07:09.831965 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 213/448] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:09 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1470 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:09.847946 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e61cf8d3-25b1-4856-a633-ef32afb59f17 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:09.848946 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e61cf8d3-25b1-4856-a633-ef32afb59f17 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:09.867924 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e61cf8d3-25b1-4856-a633-ef32afb59f17 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:09.868666 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e61cf8d3-25b1-4856-a633-ef32afb59f17 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:09.869727 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e61cf8d3-25b1-4856-a633-ef32afb59f17 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:09.870319 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e61cf8d3-25b1-4856-a633-ef32afb59f17 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:09.930218 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e61cf8d3-25b1-4856-a633-ef32afb59f17 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096906 Feb 20 20:07:09.930815 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 214/449] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:07:09 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:07:09.938684 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c86a9d64-2d6e-4ccc-bd58-4dc536805370 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:09.939368 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c86a9d64-2d6e-4ccc-bd58-4dc536805370 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:09.946141 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c86a9d64-2d6e-4ccc-bd58-4dc536805370 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:09.946582 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c86a9d64-2d6e-4ccc-bd58-4dc536805370 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:09.947480 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c86a9d64-2d6e-4ccc-bd58-4dc536805370 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:09.947908 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c86a9d64-2d6e-4ccc-bd58-4dc536805370 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:09.996537 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c543dd8b-fce7-45b5-9da6-57aedc024b2e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:10.004539 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c543dd8b-fce7-45b5-9da6-57aedc024b2e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.238532 Feb 20 20:07:10.005140 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 236/450] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:09 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:10.116883 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c86a9d64-2d6e-4ccc-bd58-4dc536805370 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:10.126704 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c86a9d64-2d6e-4ccc-bd58-4dc536805370 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:10.128483 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c86a9d64-2d6e-4ccc-bd58-4dc536805370 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:10.129835 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c86a9d64-2d6e-4ccc-bd58-4dc536805370 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.195680 Feb 20 20:07:10.130705 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 215/451] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:09 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:07:10.847881 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-30d8c87e-b0cb-4685-bd1f-7d10997c5760 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:10.848498 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-30d8c87e-b0cb-4685-bd1f-7d10997c5760 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:10.855108 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-30d8c87e-b0cb-4685-bd1f-7d10997c5760 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:10.855590 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-30d8c87e-b0cb-4685-bd1f-7d10997c5760 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:10.857050 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-30d8c87e-b0cb-4685-bd1f-7d10997c5760 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:10.857545 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-30d8c87e-b0cb-4685-bd1f-7d10997c5760 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:10.942120 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2cb51d8f-927c-4752-9776-8de016fbc503 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:10.943139 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2cb51d8f-927c-4752-9776-8de016fbc503 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:10.951005 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2cb51d8f-927c-4752-9776-8de016fbc503 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:10.951734 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2cb51d8f-927c-4752-9776-8de016fbc503 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:10.952880 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2cb51d8f-927c-4752-9776-8de016fbc503 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:10.953466 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2cb51d8f-927c-4752-9776-8de016fbc503 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:11.002156 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2cb51d8f-927c-4752-9776-8de016fbc503 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063807 Feb 20 20:07:11.006565 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 216/452] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:07:10 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:07:11.021752 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b1e44c9c-62fe-4fb7-99ad-4da8bdd130a1 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:11.022363 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b1e44c9c-62fe-4fb7-99ad-4da8bdd130a1 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:11.029468 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b1e44c9c-62fe-4fb7-99ad-4da8bdd130a1 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:11.030074 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b1e44c9c-62fe-4fb7-99ad-4da8bdd130a1 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:11.030888 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b1e44c9c-62fe-4fb7-99ad-4da8bdd130a1 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:11.031325 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b1e44c9c-62fe-4fb7-99ad-4da8bdd130a1 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:11.041604 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-30d8c87e-b0cb-4685-bd1f-7d10997c5760 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:11.050338 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-30d8c87e-b0cb-4685-bd1f-7d10997c5760 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1470 microversion: 2.1 time: 0.205963 Feb 20 20:07:11.051249 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 237/453] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:10 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1470 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:11.148071 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-efc42c5e-2391-424c-a950-886008d9cf4b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:11.149126 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-efc42c5e-2391-424c-a950-886008d9cf4b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:11.156392 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-efc42c5e-2391-424c-a950-886008d9cf4b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:11.157151 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-efc42c5e-2391-424c-a950-886008d9cf4b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:11.158159 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-efc42c5e-2391-424c-a950-886008d9cf4b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:11.158808 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-efc42c5e-2391-424c-a950-886008d9cf4b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:11.222108 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b1e44c9c-62fe-4fb7-99ad-4da8bdd130a1 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:11.232193 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b1e44c9c-62fe-4fb7-99ad-4da8bdd130a1 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.213950 Feb 20 20:07:11.233040 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 217/454] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:11 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:07:11.339919 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-efc42c5e-2391-424c-a950-886008d9cf4b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:11.349631 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-efc42c5e-2391-424c-a950-886008d9cf4b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:11.351185 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-efc42c5e-2391-424c-a950-886008d9cf4b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:11.352372 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-efc42c5e-2391-424c-a950-886008d9cf4b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.208341 Feb 20 20:07:11.364965 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 238/455] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:11 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:07:12.020152 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a10fef8d-5c29-4292-8090-4d22042343b5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:12.021880 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a10fef8d-5c29-4292-8090-4d22042343b5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:12.029040 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a10fef8d-5c29-4292-8090-4d22042343b5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:12.030160 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a10fef8d-5c29-4292-8090-4d22042343b5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:12.031014 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a10fef8d-5c29-4292-8090-4d22042343b5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:12.031545 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a10fef8d-5c29-4292-8090-4d22042343b5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:12.065555 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a10fef8d-5c29-4292-8090-4d22042343b5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049232 Feb 20 20:07:12.070399 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 218/456] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:07:12 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:07:12.072382 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d63d9305-8a83-4d24-a5e5-4f90b0e2879e tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:12.073161 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d63d9305-8a83-4d24-a5e5-4f90b0e2879e tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:12.080424 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d63d9305-8a83-4d24-a5e5-4f90b0e2879e tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:12.080967 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d63d9305-8a83-4d24-a5e5-4f90b0e2879e tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:12.081973 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d63d9305-8a83-4d24-a5e5-4f90b0e2879e tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:12.082423 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d63d9305-8a83-4d24-a5e5-4f90b0e2879e tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:12.237841 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d63d9305-8a83-4d24-a5e5-4f90b0e2879e tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:12.245626 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d63d9305-8a83-4d24-a5e5-4f90b0e2879e tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1470 microversion: 2.1 time: 0.180134 Feb 20 20:07:12.254128 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 239/457] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:12 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1470 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:07:12.254339 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9e8984ff-f32d-4c89-bca9-e2ebdb784885 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:12.254339 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9e8984ff-f32d-4c89-bca9-e2ebdb784885 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:12.257060 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9e8984ff-f32d-4c89-bca9-e2ebdb784885 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:12.257534 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9e8984ff-f32d-4c89-bca9-e2ebdb784885 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:12.258314 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9e8984ff-f32d-4c89-bca9-e2ebdb784885 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:12.258742 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9e8984ff-f32d-4c89-bca9-e2ebdb784885 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:12.373291 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e000b620-8a77-4129-87f2-6a4a26ffc5e4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:12.373910 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e000b620-8a77-4129-87f2-6a4a26ffc5e4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:12.380424 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e000b620-8a77-4129-87f2-6a4a26ffc5e4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:12.380877 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e000b620-8a77-4129-87f2-6a4a26ffc5e4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:12.381829 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e000b620-8a77-4129-87f2-6a4a26ffc5e4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:12.382256 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e000b620-8a77-4129-87f2-6a4a26ffc5e4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:12.435110 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-9e8984ff-f32d-4c89-bca9-e2ebdb784885 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:12.451997 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9e8984ff-f32d-4c89-bca9-e2ebdb784885 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.206277 Feb 20 20:07:12.453251 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 219/458] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:12 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:07:12.585494 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e000b620-8a77-4129-87f2-6a4a26ffc5e4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:12.594529 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e000b620-8a77-4129-87f2-6a4a26ffc5e4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:12.596157 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e000b620-8a77-4129-87f2-6a4a26ffc5e4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:12.597403 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e000b620-8a77-4129-87f2-6a4a26ffc5e4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.229275 Feb 20 20:07:12.598017 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 240/459] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:12 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:07:13.081213 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f15a9c26-fa77-486a-90cd-12b86863167f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:13.085344 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f15a9c26-fa77-486a-90cd-12b86863167f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:13.099059 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f15a9c26-fa77-486a-90cd-12b86863167f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:13.099511 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f15a9c26-fa77-486a-90cd-12b86863167f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:13.100500 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f15a9c26-fa77-486a-90cd-12b86863167f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:13.100948 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f15a9c26-fa77-486a-90cd-12b86863167f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:13.132559 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f15a9c26-fa77-486a-90cd-12b86863167f tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058598 Feb 20 20:07:13.133157 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 220/460] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:07:13 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:07:13.264613 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-70e0bce8-68cc-4ffe-8f31-081371f09751 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:13.265279 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-70e0bce8-68cc-4ffe-8f31-081371f09751 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:13.271585 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-70e0bce8-68cc-4ffe-8f31-081371f09751 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:13.272031 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-70e0bce8-68cc-4ffe-8f31-081371f09751 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:13.272800 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-70e0bce8-68cc-4ffe-8f31-081371f09751 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:13.273266 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-70e0bce8-68cc-4ffe-8f31-081371f09751 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:13.413735 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-70e0bce8-68cc-4ffe-8f31-081371f09751 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:13.421059 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-70e0bce8-68cc-4ffe-8f31-081371f09751 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1470 microversion: 2.1 time: 0.160704 Feb 20 20:07:13.421646 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 241/461] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:13 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:13.469302 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e3acf8a2-7d17-4755-84e3-4f1dad8a8684 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:13.469907 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e3acf8a2-7d17-4755-84e3-4f1dad8a8684 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:13.475902 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e3acf8a2-7d17-4755-84e3-4f1dad8a8684 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:13.476450 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e3acf8a2-7d17-4755-84e3-4f1dad8a8684 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:13.477261 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e3acf8a2-7d17-4755-84e3-4f1dad8a8684 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:13.477697 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e3acf8a2-7d17-4755-84e3-4f1dad8a8684 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:13.615773 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-28986ac1-73f9-41ac-bddb-742e1c7a85b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:13.616294 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-28986ac1-73f9-41ac-bddb-742e1c7a85b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:13.623630 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-28986ac1-73f9-41ac-bddb-742e1c7a85b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:13.624116 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-28986ac1-73f9-41ac-bddb-742e1c7a85b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:13.624908 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-28986ac1-73f9-41ac-bddb-742e1c7a85b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:13.625370 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-28986ac1-73f9-41ac-bddb-742e1c7a85b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:13.629674 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e3acf8a2-7d17-4755-84e3-4f1dad8a8684 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:13.638518 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e3acf8a2-7d17-4755-84e3-4f1dad8a8684 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.171971 Feb 20 20:07:13.639588 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 221/462] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:13 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:13.779858 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-28986ac1-73f9-41ac-bddb-742e1c7a85b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:13.796206 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-28986ac1-73f9-41ac-bddb-742e1c7a85b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:13.799864 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-28986ac1-73f9-41ac-bddb-742e1c7a85b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:13.801916 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-28986ac1-73f9-41ac-bddb-742e1c7a85b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.189690 Feb 20 20:07:13.803254 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 242/463] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:13 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:07:14.146887 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4c0fc79d-4f3e-4ec1-95e3-210ddac831b2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:14.148776 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4c0fc79d-4f3e-4ec1-95e3-210ddac831b2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:14.158848 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4c0fc79d-4f3e-4ec1-95e3-210ddac831b2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:14.159391 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4c0fc79d-4f3e-4ec1-95e3-210ddac831b2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:14.160267 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4c0fc79d-4f3e-4ec1-95e3-210ddac831b2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:14.160780 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4c0fc79d-4f3e-4ec1-95e3-210ddac831b2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:14.191291 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4c0fc79d-4f3e-4ec1-95e3-210ddac831b2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050379 Feb 20 20:07:14.191850 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 222/464] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:07:14 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:07:14.440123 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6e17c68a-046a-46ba-b5c7-d6e40f42f86b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:14.440813 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6e17c68a-046a-46ba-b5c7-d6e40f42f86b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:14.447200 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6e17c68a-046a-46ba-b5c7-d6e40f42f86b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:14.447673 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6e17c68a-046a-46ba-b5c7-d6e40f42f86b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:14.448462 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6e17c68a-046a-46ba-b5c7-d6e40f42f86b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:14.448897 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6e17c68a-046a-46ba-b5c7-d6e40f42f86b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:14.641853 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6e17c68a-046a-46ba-b5c7-d6e40f42f86b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:14.655924 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6e17c68a-046a-46ba-b5c7-d6e40f42f86b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1470 microversion: 2.1 time: 0.218548 Feb 20 20:07:14.656784 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-fafc9b2c-28dc-46f6-a2f4-e83e48be1f26 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:14.664027 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 243/465] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:14 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1470 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:14.668482 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-fafc9b2c-28dc-46f6-a2f4-e83e48be1f26 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:14.681305 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fafc9b2c-28dc-46f6-a2f4-e83e48be1f26 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:14.682338 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fafc9b2c-28dc-46f6-a2f4-e83e48be1f26 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:14.683518 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fafc9b2c-28dc-46f6-a2f4-e83e48be1f26 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:14.685366 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fafc9b2c-28dc-46f6-a2f4-e83e48be1f26 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:14.830324 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b5152528-9db2-495f-9eaf-40dcdbe9022d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:14.831083 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b5152528-9db2-495f-9eaf-40dcdbe9022d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:14.841541 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b5152528-9db2-495f-9eaf-40dcdbe9022d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:14.841980 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b5152528-9db2-495f-9eaf-40dcdbe9022d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:14.843218 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b5152528-9db2-495f-9eaf-40dcdbe9022d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:14.844330 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b5152528-9db2-495f-9eaf-40dcdbe9022d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:14.867498 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-fafc9b2c-28dc-46f6-a2f4-e83e48be1f26 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:14.878666 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-fafc9b2c-28dc-46f6-a2f4-e83e48be1f26 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.226475 Feb 20 20:07:14.879563 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 223/466] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:14 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:07:15.093277 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b5152528-9db2-495f-9eaf-40dcdbe9022d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:15.101886 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b5152528-9db2-495f-9eaf-40dcdbe9022d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:15.103568 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b5152528-9db2-495f-9eaf-40dcdbe9022d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:15.104734 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b5152528-9db2-495f-9eaf-40dcdbe9022d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.285130 Feb 20 20:07:15.106020 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 244/467] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:14 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:07:15.203647 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-cfa3044b-8fb8-42b5-803f-0329f399aceb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:15.205966 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-cfa3044b-8fb8-42b5-803f-0329f399aceb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:15.214121 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cfa3044b-8fb8-42b5-803f-0329f399aceb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:15.215660 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cfa3044b-8fb8-42b5-803f-0329f399aceb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:15.216923 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cfa3044b-8fb8-42b5-803f-0329f399aceb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:15.217744 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cfa3044b-8fb8-42b5-803f-0329f399aceb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:15.252279 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-cfa3044b-8fb8-42b5-803f-0329f399aceb tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053035 Feb 20 20:07:15.252839 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 224/468] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:07:15 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:07:15.681761 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d41cb4b6-7441-4ac5-802c-d2908d6df4a4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:15.683298 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d41cb4b6-7441-4ac5-802c-d2908d6df4a4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:15.691001 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d41cb4b6-7441-4ac5-802c-d2908d6df4a4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:15.691785 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d41cb4b6-7441-4ac5-802c-d2908d6df4a4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:15.692875 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d41cb4b6-7441-4ac5-802c-d2908d6df4a4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:15.693812 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d41cb4b6-7441-4ac5-802c-d2908d6df4a4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:15.881251 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d41cb4b6-7441-4ac5-802c-d2908d6df4a4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:15.890159 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d41cb4b6-7441-4ac5-802c-d2908d6df4a4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1470 microversion: 2.1 time: 0.212897 Feb 20 20:07:15.895918 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-69e45667-45e5-4a05-8c21-4ee0c16a0030 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:15.896536 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-69e45667-45e5-4a05-8c21-4ee0c16a0030 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:15.898437 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 245/469] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:15 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1470 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:07:15.909045 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-69e45667-45e5-4a05-8c21-4ee0c16a0030 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:15.909045 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-69e45667-45e5-4a05-8c21-4ee0c16a0030 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:15.909045 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-69e45667-45e5-4a05-8c21-4ee0c16a0030 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:15.909045 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-69e45667-45e5-4a05-8c21-4ee0c16a0030 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:16.084326 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-69e45667-45e5-4a05-8c21-4ee0c16a0030 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:16.094086 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-69e45667-45e5-4a05-8c21-4ee0c16a0030 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.201980 Feb 20 20:07:16.102623 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 225/470] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:15 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:16.124102 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-41036d2f-365b-49c8-8b17-c7ecf77f9fd3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:16.124697 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-41036d2f-365b-49c8-8b17-c7ecf77f9fd3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:16.130592 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-41036d2f-365b-49c8-8b17-c7ecf77f9fd3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:16.131029 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-41036d2f-365b-49c8-8b17-c7ecf77f9fd3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:16.131792 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-41036d2f-365b-49c8-8b17-c7ecf77f9fd3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:16.132219 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-41036d2f-365b-49c8-8b17-c7ecf77f9fd3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:16.274132 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8f54dc8e-d964-41fb-b32b-9136194cf2f7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:16.274132 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8f54dc8e-d964-41fb-b32b-9136194cf2f7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:16.274856 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8f54dc8e-d964-41fb-b32b-9136194cf2f7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:16.275012 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8f54dc8e-d964-41fb-b32b-9136194cf2f7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:16.275831 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8f54dc8e-d964-41fb-b32b-9136194cf2f7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:16.276276 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8f54dc8e-d964-41fb-b32b-9136194cf2f7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:16.290070 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-41036d2f-365b-49c8-8b17-c7ecf77f9fd3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:16.311122 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-41036d2f-365b-49c8-8b17-c7ecf77f9fd3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:16.312910 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-41036d2f-365b-49c8-8b17-c7ecf77f9fd3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:16.314311 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-41036d2f-365b-49c8-8b17-c7ecf77f9fd3 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.194460 Feb 20 20:07:16.315518 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 246/471] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:16 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:07:16.327491 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8f54dc8e-d964-41fb-b32b-9136194cf2f7 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066695 Feb 20 20:07:16.330360 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 226/472] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:07:16 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:07:16.920691 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-29e93a97-a115-4130-9bb9-b971f1603cc6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:16.921337 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-29e93a97-a115-4130-9bb9-b971f1603cc6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:16.928098 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-29e93a97-a115-4130-9bb9-b971f1603cc6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:16.928529 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-29e93a97-a115-4130-9bb9-b971f1603cc6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:16.929586 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-29e93a97-a115-4130-9bb9-b971f1603cc6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:16.929757 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-29e93a97-a115-4130-9bb9-b971f1603cc6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:17.111874 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ac088622-1879-4f12-aef4-c3364ba357f2 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:17.112134 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ac088622-1879-4f12-aef4-c3364ba357f2 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:17.122114 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ac088622-1879-4f12-aef4-c3364ba357f2 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:17.123824 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ac088622-1879-4f12-aef4-c3364ba357f2 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:17.124765 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ac088622-1879-4f12-aef4-c3364ba357f2 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:17.127079 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ac088622-1879-4f12-aef4-c3364ba357f2 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:17.162582 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-29e93a97-a115-4130-9bb9-b971f1603cc6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:17.173958 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-29e93a97-a115-4130-9bb9-b971f1603cc6 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1470 microversion: 2.1 time: 0.260652 Feb 20 20:07:17.175163 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 247/473] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:16 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1470 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:17.304343 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ac088622-1879-4f12-aef4-c3364ba357f2 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:17.313944 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ac088622-1879-4f12-aef4-c3364ba357f2 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.205924 Feb 20 20:07:17.329257 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 227/474] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:17 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:17.347838 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-46657a21-20ff-40b0-a8c6-25405cf75221 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:17.354806 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3722c055-fe0a-4682-9097-2269ba0c8e9e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:17.355013 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-46657a21-20ff-40b0-a8c6-25405cf75221 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:17.355137 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3722c055-fe0a-4682-9097-2269ba0c8e9e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:17.359157 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-46657a21-20ff-40b0-a8c6-25405cf75221 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:17.359661 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-46657a21-20ff-40b0-a8c6-25405cf75221 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:17.359861 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3722c055-fe0a-4682-9097-2269ba0c8e9e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:17.360633 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3722c055-fe0a-4682-9097-2269ba0c8e9e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:17.360856 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-46657a21-20ff-40b0-a8c6-25405cf75221 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:17.361247 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-46657a21-20ff-40b0-a8c6-25405cf75221 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:17.361974 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3722c055-fe0a-4682-9097-2269ba0c8e9e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:17.362585 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3722c055-fe0a-4682-9097-2269ba0c8e9e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:17.430720 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3722c055-fe0a-4682-9097-2269ba0c8e9e tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085124 Feb 20 20:07:17.431999 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 228/475] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:07:17 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:07:17.590816 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-46657a21-20ff-40b0-a8c6-25405cf75221 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:17.606982 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-46657a21-20ff-40b0-a8c6-25405cf75221 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:17.608963 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-46657a21-20ff-40b0-a8c6-25405cf75221 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:17.610231 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-46657a21-20ff-40b0-a8c6-25405cf75221 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.270304 Feb 20 20:07:17.611031 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 248/476] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:17 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:07:18.192383 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-041607fa-0bbf-411c-8634-c8ea3c9865f0 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:18.193431 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-041607fa-0bbf-411c-8634-c8ea3c9865f0 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:18.201177 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-041607fa-0bbf-411c-8634-c8ea3c9865f0 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:18.201731 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-041607fa-0bbf-411c-8634-c8ea3c9865f0 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:18.202541 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-041607fa-0bbf-411c-8634-c8ea3c9865f0 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:18.202970 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-041607fa-0bbf-411c-8634-c8ea3c9865f0 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:18.346361 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bd88bc9b-c11f-4bd3-b7bf-dbc83763caea tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:18.348793 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-bd88bc9b-c11f-4bd3-b7bf-dbc83763caea tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:18.362954 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bd88bc9b-c11f-4bd3-b7bf-dbc83763caea tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:18.363848 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bd88bc9b-c11f-4bd3-b7bf-dbc83763caea tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:18.365703 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bd88bc9b-c11f-4bd3-b7bf-dbc83763caea tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:18.366403 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bd88bc9b-c11f-4bd3-b7bf-dbc83763caea tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:18.543899 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-041607fa-0bbf-411c-8634-c8ea3c9865f0 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:18.553904 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-041607fa-0bbf-411c-8634-c8ea3c9865f0 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1470 microversion: 2.1 time: 0.365438 Feb 20 20:07:18.565987 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 229/477] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:18 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1470 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:18.565987 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b824277d-fc92-4e4f-bbf7-edad357182c4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:18.565987 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b824277d-fc92-4e4f-bbf7-edad357182c4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:18.575890 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b824277d-fc92-4e4f-bbf7-edad357182c4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:18.577011 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b824277d-fc92-4e4f-bbf7-edad357182c4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:18.578406 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b824277d-fc92-4e4f-bbf7-edad357182c4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:18.579138 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b824277d-fc92-4e4f-bbf7-edad357182c4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:18.636769 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b824277d-fc92-4e4f-bbf7-edad357182c4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080973 Feb 20 20:07:18.639972 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 230/478] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:07:18 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:07:18.648624 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f3801f4e-9d7e-41e6-8ee1-8cffa4199566 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:18.650599 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f3801f4e-9d7e-41e6-8ee1-8cffa4199566 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:18.664417 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f3801f4e-9d7e-41e6-8ee1-8cffa4199566 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:18.665173 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f3801f4e-9d7e-41e6-8ee1-8cffa4199566 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:18.665910 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-bd88bc9b-c11f-4bd3-b7bf-dbc83763caea tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:18.666488 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f3801f4e-9d7e-41e6-8ee1-8cffa4199566 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:18.667192 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f3801f4e-9d7e-41e6-8ee1-8cffa4199566 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:18.679168 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-bd88bc9b-c11f-4bd3-b7bf-dbc83763caea tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.340353 Feb 20 20:07:18.679754 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 249/479] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:18 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:07:18.826391 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f3801f4e-9d7e-41e6-8ee1-8cffa4199566 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:18.837734 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f3801f4e-9d7e-41e6-8ee1-8cffa4199566 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:18.840091 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f3801f4e-9d7e-41e6-8ee1-8cffa4199566 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:18.842547 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f3801f4e-9d7e-41e6-8ee1-8cffa4199566 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.200878 Feb 20 20:07:18.843132 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 231/480] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:18 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:07:19.579991 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a0c651ec-0061-4998-ae84-b7c9e61e4d6f tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:19.580663 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a0c651ec-0061-4998-ae84-b7c9e61e4d6f tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:19.587479 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a0c651ec-0061-4998-ae84-b7c9e61e4d6f tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:19.587938 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a0c651ec-0061-4998-ae84-b7c9e61e4d6f tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:19.588728 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a0c651ec-0061-4998-ae84-b7c9e61e4d6f tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:19.589186 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a0c651ec-0061-4998-ae84-b7c9e61e4d6f tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:19.652942 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-0dac532c-e3df-4811-8a61-cb36e8f060c5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:19.653812 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-0dac532c-e3df-4811-8a61-cb36e8f060c5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:19.659944 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0dac532c-e3df-4811-8a61-cb36e8f060c5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:19.660637 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0dac532c-e3df-4811-8a61-cb36e8f060c5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:19.661468 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0dac532c-e3df-4811-8a61-cb36e8f060c5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:19.661906 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0dac532c-e3df-4811-8a61-cb36e8f060c5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:19.701077 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-0dac532c-e3df-4811-8a61-cb36e8f060c5 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053068 Feb 20 20:07:19.701799 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 232/481] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:07:19 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:07:19.706350 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-dadd2430-1934-4811-b006-61794bfefa1a tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:19.706962 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-dadd2430-1934-4811-b006-61794bfefa1a tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:19.713379 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dadd2430-1934-4811-b006-61794bfefa1a tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:19.713836 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dadd2430-1934-4811-b006-61794bfefa1a tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:19.714624 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dadd2430-1934-4811-b006-61794bfefa1a tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:19.715060 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dadd2430-1934-4811-b006-61794bfefa1a tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:19.754054 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a0c651ec-0061-4998-ae84-b7c9e61e4d6f tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:19.764018 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a0c651ec-0061-4998-ae84-b7c9e61e4d6f tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1470 microversion: 2.1 time: 0.187425 Feb 20 20:07:19.764639 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 250/482] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:19 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1470 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:19.862003 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c98c4a1f-9ad7-41b9-b275-1bbc785c4d20 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:19.862645 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c98c4a1f-9ad7-41b9-b275-1bbc785c4d20 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:19.869000 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c98c4a1f-9ad7-41b9-b275-1bbc785c4d20 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:19.869582 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c98c4a1f-9ad7-41b9-b275-1bbc785c4d20 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:19.870545 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c98c4a1f-9ad7-41b9-b275-1bbc785c4d20 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:19.870984 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c98c4a1f-9ad7-41b9-b275-1bbc785c4d20 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:19.890546 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-dadd2430-1934-4811-b006-61794bfefa1a tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:19.898428 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-dadd2430-1934-4811-b006-61794bfefa1a tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.195560 Feb 20 20:07:19.899020 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 233/483] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:19 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:20.034737 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c98c4a1f-9ad7-41b9-b275-1bbc785c4d20 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:20.050023 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c98c4a1f-9ad7-41b9-b275-1bbc785c4d20 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:20.052683 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c98c4a1f-9ad7-41b9-b275-1bbc785c4d20 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:20.054682 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c98c4a1f-9ad7-41b9-b275-1bbc785c4d20 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.196253 Feb 20 20:07:20.055618 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 251/484] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:19 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:07:20.712092 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-df1c3471-ec0e-42a0-8b1a-a485c0cfdc81 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:20.713005 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-df1c3471-ec0e-42a0-8b1a-a485c0cfdc81 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:20.728067 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-df1c3471-ec0e-42a0-8b1a-a485c0cfdc81 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:20.728422 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-df1c3471-ec0e-42a0-8b1a-a485c0cfdc81 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:20.729295 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-df1c3471-ec0e-42a0-8b1a-a485c0cfdc81 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:20.729899 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-df1c3471-ec0e-42a0-8b1a-a485c0cfdc81 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:20.764797 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-df1c3471-ec0e-42a0-8b1a-a485c0cfdc81 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056426 Feb 20 20:07:20.765420 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 234/485] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:07:20 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:07:20.781986 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4aa5a94f-1ef0-4ad2-bee3-c2f04d8e46dc tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:20.782598 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4aa5a94f-1ef0-4ad2-bee3-c2f04d8e46dc tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:20.790173 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4aa5a94f-1ef0-4ad2-bee3-c2f04d8e46dc tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:20.790624 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4aa5a94f-1ef0-4ad2-bee3-c2f04d8e46dc tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:20.791414 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4aa5a94f-1ef0-4ad2-bee3-c2f04d8e46dc tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:20.791881 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4aa5a94f-1ef0-4ad2-bee3-c2f04d8e46dc tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:20.916021 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6b45f94e-d91c-43f8-a5a5-681c83f140c7 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:20.916639 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6b45f94e-d91c-43f8-a5a5-681c83f140c7 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:20.923034 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6b45f94e-d91c-43f8-a5a5-681c83f140c7 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:20.923538 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6b45f94e-d91c-43f8-a5a5-681c83f140c7 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:20.924385 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6b45f94e-d91c-43f8-a5a5-681c83f140c7 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:20.924833 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6b45f94e-d91c-43f8-a5a5-681c83f140c7 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:20.969568 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4aa5a94f-1ef0-4ad2-bee3-c2f04d8e46dc tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:20.978479 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4aa5a94f-1ef0-4ad2-bee3-c2f04d8e46dc tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1470 microversion: 2.1 time: 0.200727 Feb 20 20:07:20.979020 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 252/486] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:20 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1470 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:21.083199 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-faed3e25-8e8c-4018-9548-17f8a2dc0ac5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:21.084435 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-faed3e25-8e8c-4018-9548-17f8a2dc0ac5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:21.093651 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-faed3e25-8e8c-4018-9548-17f8a2dc0ac5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:21.094303 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-faed3e25-8e8c-4018-9548-17f8a2dc0ac5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:21.095217 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-faed3e25-8e8c-4018-9548-17f8a2dc0ac5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:21.095784 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-faed3e25-8e8c-4018-9548-17f8a2dc0ac5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:21.109052 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6b45f94e-d91c-43f8-a5a5-681c83f140c7 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:21.123345 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6b45f94e-d91c-43f8-a5a5-681c83f140c7 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.210582 Feb 20 20:07:21.124163 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 235/487] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:20 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:07:21.273817 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-faed3e25-8e8c-4018-9548-17f8a2dc0ac5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:21.283448 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-faed3e25-8e8c-4018-9548-17f8a2dc0ac5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:21.284940 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-faed3e25-8e8c-4018-9548-17f8a2dc0ac5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:21.286280 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-faed3e25-8e8c-4018-9548-17f8a2dc0ac5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.210087 Feb 20 20:07:21.290948 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 253/488] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:21 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:07:21.775931 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-92b9cc40-7ad7-439b-80e6-d59195936454 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:21.776859 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-92b9cc40-7ad7-439b-80e6-d59195936454 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:21.784792 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92b9cc40-7ad7-439b-80e6-d59195936454 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:21.785287 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92b9cc40-7ad7-439b-80e6-d59195936454 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:21.786197 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92b9cc40-7ad7-439b-80e6-d59195936454 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:21.786725 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92b9cc40-7ad7-439b-80e6-d59195936454 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:21.820329 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-92b9cc40-7ad7-439b-80e6-d59195936454 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048111 Feb 20 20:07:21.821014 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 236/489] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:07:21 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:07:21.996882 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4e7b2ad8-35bd-4dc5-9e28-7b3545f2875b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:21.997740 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4e7b2ad8-35bd-4dc5-9e28-7b3545f2875b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:22.004674 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4e7b2ad8-35bd-4dc5-9e28-7b3545f2875b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:22.005144 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4e7b2ad8-35bd-4dc5-9e28-7b3545f2875b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:22.005950 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4e7b2ad8-35bd-4dc5-9e28-7b3545f2875b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:22.006393 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4e7b2ad8-35bd-4dc5-9e28-7b3545f2875b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:22.148636 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-44d4770c-49ed-4897-9082-5fb086cd321b tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:22.151562 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-44d4770c-49ed-4897-9082-5fb086cd321b tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:22.160505 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-44d4770c-49ed-4897-9082-5fb086cd321b tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:22.160964 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-44d4770c-49ed-4897-9082-5fb086cd321b tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:22.162052 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-44d4770c-49ed-4897-9082-5fb086cd321b tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:22.162738 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-44d4770c-49ed-4897-9082-5fb086cd321b tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:22.191344 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4e7b2ad8-35bd-4dc5-9e28-7b3545f2875b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:22.202004 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4e7b2ad8-35bd-4dc5-9e28-7b3545f2875b tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1470 microversion: 2.1 time: 0.209129 Feb 20 20:07:22.202763 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 254/490] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:21 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1470 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:22.308260 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e2dff238-33aa-41d2-b5c9-be6754941134 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:22.309890 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e2dff238-33aa-41d2-b5c9-be6754941134 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:22.317470 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e2dff238-33aa-41d2-b5c9-be6754941134 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:22.318150 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e2dff238-33aa-41d2-b5c9-be6754941134 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:22.319238 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e2dff238-33aa-41d2-b5c9-be6754941134 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:22.319791 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e2dff238-33aa-41d2-b5c9-be6754941134 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:22.336967 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-44d4770c-49ed-4897-9082-5fb086cd321b tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:22.343072 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-44d4770c-49ed-4897-9082-5fb086cd321b tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.201213 Feb 20 20:07:22.344054 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 237/491] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:22 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:07:22.502672 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e2dff238-33aa-41d2-b5c9-be6754941134 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:22.512840 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e2dff238-33aa-41d2-b5c9-be6754941134 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:22.514394 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e2dff238-33aa-41d2-b5c9-be6754941134 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:22.515561 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e2dff238-33aa-41d2-b5c9-be6754941134 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.211207 Feb 20 20:07:22.516125 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 255/492] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:22 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:07:22.833199 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-881cb63d-a795-4318-9298-7177cd6c2858 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:22.834593 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-881cb63d-a795-4318-9298-7177cd6c2858 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:22.843483 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-881cb63d-a795-4318-9298-7177cd6c2858 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:22.844018 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-881cb63d-a795-4318-9298-7177cd6c2858 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:22.844941 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-881cb63d-a795-4318-9298-7177cd6c2858 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:22.845433 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-881cb63d-a795-4318-9298-7177cd6c2858 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:22.878898 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-881cb63d-a795-4318-9298-7177cd6c2858 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050402 Feb 20 20:07:22.879510 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 238/493] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:07:22 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:07:23.219985 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ebc9542b-74e9-4941-9c6a-4b75bef7ba4f tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:23.220646 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ebc9542b-74e9-4941-9c6a-4b75bef7ba4f tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:23.227106 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ebc9542b-74e9-4941-9c6a-4b75bef7ba4f tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:23.227549 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ebc9542b-74e9-4941-9c6a-4b75bef7ba4f tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:23.228355 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ebc9542b-74e9-4941-9c6a-4b75bef7ba4f tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:23.228863 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ebc9542b-74e9-4941-9c6a-4b75bef7ba4f tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:23.367193 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d6bb643d-fe87-4c46-bde5-555f74b692da tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:23.368297 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d6bb643d-fe87-4c46-bde5-555f74b692da tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:23.377378 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d6bb643d-fe87-4c46-bde5-555f74b692da tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:23.381426 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d6bb643d-fe87-4c46-bde5-555f74b692da tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:23.381426 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d6bb643d-fe87-4c46-bde5-555f74b692da tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:23.381426 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d6bb643d-fe87-4c46-bde5-555f74b692da tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:23.392432 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ebc9542b-74e9-4941-9c6a-4b75bef7ba4f tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:23.400358 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ebc9542b-74e9-4941-9c6a-4b75bef7ba4f tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1470 microversion: 2.1 time: 0.184766 Feb 20 20:07:23.400985 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 256/494] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:23 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1470 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:23.526793 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d6bb643d-fe87-4c46-bde5-555f74b692da tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:23.534692 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c2f5153c-e2f8-4dea-9e92-e6706f97c9c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:23.535349 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d6bb643d-fe87-4c46-bde5-555f74b692da tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.172565 Feb 20 20:07:23.535592 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c2f5153c-e2f8-4dea-9e92-e6706f97c9c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:23.535928 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 239/495] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:23 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:23.545336 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c2f5153c-e2f8-4dea-9e92-e6706f97c9c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:23.545336 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c2f5153c-e2f8-4dea-9e92-e6706f97c9c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:23.545336 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c2f5153c-e2f8-4dea-9e92-e6706f97c9c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:23.545336 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c2f5153c-e2f8-4dea-9e92-e6706f97c9c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:23.682013 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c2f5153c-e2f8-4dea-9e92-e6706f97c9c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:23.690246 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c2f5153c-e2f8-4dea-9e92-e6706f97c9c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:23.691744 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c2f5153c-e2f8-4dea-9e92-e6706f97c9c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:23.692914 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c2f5153c-e2f8-4dea-9e92-e6706f97c9c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.161904 Feb 20 20:07:23.693690 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 257/496] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:23 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:07:23.891796 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ea0b12cf-3338-4e13-8ba5-6fd262cff602 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:23.893275 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ea0b12cf-3338-4e13-8ba5-6fd262cff602 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:23.899969 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ea0b12cf-3338-4e13-8ba5-6fd262cff602 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:23.900481 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ea0b12cf-3338-4e13-8ba5-6fd262cff602 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:23.901401 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ea0b12cf-3338-4e13-8ba5-6fd262cff602 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:23.901885 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ea0b12cf-3338-4e13-8ba5-6fd262cff602 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:23.939499 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ea0b12cf-3338-4e13-8ba5-6fd262cff602 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052400 Feb 20 20:07:23.940209 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 240/497] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:07:23 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:07:24.417615 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7c6a2e66-3bee-440b-b8df-dd251beaacb7 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:24.418194 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7c6a2e66-3bee-440b-b8df-dd251beaacb7 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:24.425672 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7c6a2e66-3bee-440b-b8df-dd251beaacb7 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:24.426137 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7c6a2e66-3bee-440b-b8df-dd251beaacb7 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:24.426948 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7c6a2e66-3bee-440b-b8df-dd251beaacb7 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:24.427415 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7c6a2e66-3bee-440b-b8df-dd251beaacb7 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:24.552847 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-35ea5c07-46e9-41d1-ab0c-b45baaa60d2d tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:24.553710 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-35ea5c07-46e9-41d1-ab0c-b45baaa60d2d tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:24.567087 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-35ea5c07-46e9-41d1-ab0c-b45baaa60d2d tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:24.567087 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-35ea5c07-46e9-41d1-ab0c-b45baaa60d2d tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:24.567087 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-35ea5c07-46e9-41d1-ab0c-b45baaa60d2d tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:24.567087 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-35ea5c07-46e9-41d1-ab0c-b45baaa60d2d tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:24.596384 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7c6a2e66-3bee-440b-b8df-dd251beaacb7 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:24.604131 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7c6a2e66-3bee-440b-b8df-dd251beaacb7 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1470 microversion: 2.1 time: 0.190125 Feb 20 20:07:24.605142 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 258/498] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:24 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1470 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:24.714921 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8427135d-8759-447c-9942-2788f220f0a7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:24.716634 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8427135d-8759-447c-9942-2788f220f0a7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:24.719488 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-35ea5c07-46e9-41d1-ab0c-b45baaa60d2d tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:24.726494 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8427135d-8759-447c-9942-2788f220f0a7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:24.727241 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8427135d-8759-447c-9942-2788f220f0a7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:24.728552 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8427135d-8759-447c-9942-2788f220f0a7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:24.729050 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8427135d-8759-447c-9942-2788f220f0a7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:24.733640 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-35ea5c07-46e9-41d1-ab0c-b45baaa60d2d tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1260 microversion: 2.1 time: 0.184119 Feb 20 20:07:24.734773 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 241/499] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:24 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:07:24.953870 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8427135d-8759-447c-9942-2788f220f0a7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:24.955438 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-904a2440-48d0-4ee3-a10a-35fcad1f1807 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:24.958141 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-904a2440-48d0-4ee3-a10a-35fcad1f1807 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:24.967954 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-904a2440-48d0-4ee3-a10a-35fcad1f1807 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:24.972842 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8427135d-8759-447c-9942-2788f220f0a7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:24.973018 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-904a2440-48d0-4ee3-a10a-35fcad1f1807 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:24.973018 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-904a2440-48d0-4ee3-a10a-35fcad1f1807 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:24.973018 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-904a2440-48d0-4ee3-a10a-35fcad1f1807 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:24.973304 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8427135d-8759-447c-9942-2788f220f0a7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:24.973304 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8427135d-8759-447c-9942-2788f220f0a7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.263965 Feb 20 20:07:24.974197 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 259/500] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:24 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:07:25.007280 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-904a2440-48d0-4ee3-a10a-35fcad1f1807 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058803 Feb 20 20:07:25.007850 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 242/501] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:07:24 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:07:25.359439 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-0e3fd3dd-d41e-448a-a141-1f55bb85e86c req-07cf5ac2-8b18-4083-9b38-f8efafcfa431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daac6aee-3c43-42a7-ad5d-c24028e3ed27", "name": "network-vif-deleted", "tag": "3ca3ecd0-c84f-4ba7-8184-68fb80a53152"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:07:25.361615 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:07:25.361615 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:07:25.374180 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-0e3fd3dd-d41e-448a-a141-1f55bb85e86c req-07cf5ac2-8b18-4083-9b38-f8efafcfa431 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:25.374699 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-0e3fd3dd-d41e-448a-a141-1f55bb85e86c req-07cf5ac2-8b18-4083-9b38-f8efafcfa431 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:25.397773 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-0e3fd3dd-d41e-448a-a141-1f55bb85e86c req-07cf5ac2-8b18-4083-9b38-f8efafcfa431 service nova] Creating event network-vif-deleted:3ca3ecd0-c84f-4ba7-8184-68fb80a53152 for instance daac6aee-3c43-42a7-ad5d-c24028e3ed27 on hv-cinder-83008 Feb 20 20:07:25.406062 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-0e3fd3dd-d41e-448a-a141-1f55bb85e86c req-07cf5ac2-8b18-4083-9b38-f8efafcfa431 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051639 Feb 20 20:07:25.408245 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 260/502] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:07:25.623301 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-669fd527-5a84-4330-af97-c13c2a6d678e tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:25.624435 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-669fd527-5a84-4330-af97-c13c2a6d678e tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:25.632720 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-669fd527-5a84-4330-af97-c13c2a6d678e tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:25.633582 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-669fd527-5a84-4330-af97-c13c2a6d678e tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:25.635203 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-669fd527-5a84-4330-af97-c13c2a6d678e tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:25.635807 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-669fd527-5a84-4330-af97-c13c2a6d678e tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:25.707046 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-669fd527-5a84-4330-af97-c13c2a6d678e tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:25.710913 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-669fd527-5a84-4330-af97-c13c2a6d678e tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1299 microversion: 2.1 time: 0.092530 Feb 20 20:07:25.711496 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 243/503] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:25 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1299 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:25.763631 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bd3f1ade-4ec7-423e-90f3-675fbab6dffc tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:25.764337 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-bd3f1ade-4ec7-423e-90f3-675fbab6dffc tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:25.771133 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bd3f1ade-4ec7-423e-90f3-675fbab6dffc tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:25.771870 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bd3f1ade-4ec7-423e-90f3-675fbab6dffc tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:25.772723 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bd3f1ade-4ec7-423e-90f3-675fbab6dffc tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:25.773287 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bd3f1ade-4ec7-423e-90f3-675fbab6dffc tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:25.944205 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-bd3f1ade-4ec7-423e-90f3-675fbab6dffc tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:25.952459 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-bd3f1ade-4ec7-423e-90f3-675fbab6dffc tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1444 microversion: 2.1 time: 0.194266 Feb 20 20:07:25.952984 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 261/504] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:25 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1444 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:25.969829 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-92157939-88ca-4a7e-9125-ec2d18285bed tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:25.970433 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-92157939-88ca-4a7e-9125-ec2d18285bed tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:25.976981 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92157939-88ca-4a7e-9125-ec2d18285bed tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:25.977463 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92157939-88ca-4a7e-9125-ec2d18285bed tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:25.978232 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92157939-88ca-4a7e-9125-ec2d18285bed tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:25.978667 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92157939-88ca-4a7e-9125-ec2d18285bed tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:26.002851 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e835526c-1177-4a70-b65e-082dd808e81f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:26.003579 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e835526c-1177-4a70-b65e-082dd808e81f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:26.009730 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e835526c-1177-4a70-b65e-082dd808e81f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:26.010265 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e835526c-1177-4a70-b65e-082dd808e81f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:26.011117 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e835526c-1177-4a70-b65e-082dd808e81f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:26.011559 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e835526c-1177-4a70-b65e-082dd808e81f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:26.211105 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-92157939-88ca-4a7e-9125-ec2d18285bed tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:26.222973 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e835526c-1177-4a70-b65e-082dd808e81f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:26.227065 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-92157939-88ca-4a7e-9125-ec2d18285bed tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1444 microversion: 2.1 time: 0.254348 Feb 20 20:07:26.228263 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 244/505] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:25 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1444 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:26.234253 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f212a9c3-5789-47dc-aeb5-74977ef16ba2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:26.239693 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f212a9c3-5789-47dc-aeb5-74977ef16ba2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:26.241850 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e835526c-1177-4a70-b65e-082dd808e81f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:26.242945 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f212a9c3-5789-47dc-aeb5-74977ef16ba2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:26.243638 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f212a9c3-5789-47dc-aeb5-74977ef16ba2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:26.244645 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f212a9c3-5789-47dc-aeb5-74977ef16ba2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:26.246003 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e835526c-1177-4a70-b65e-082dd808e81f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:26.252991 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f212a9c3-5789-47dc-aeb5-74977ef16ba2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:26.257485 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e835526c-1177-4a70-b65e-082dd808e81f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.250476 Feb 20 20:07:26.259542 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 262/506] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:25 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:07:26.331246 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f212a9c3-5789-47dc-aeb5-74977ef16ba2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.101439 Feb 20 20:07:26.339030 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 245/507] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:07:26 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 20 20:07:26.740136 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bdecfea2-caa9-4e16-9cab-68292a4cc02a tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:26.740136 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-bdecfea2-caa9-4e16-9cab-68292a4cc02a tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:26.743185 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bdecfea2-caa9-4e16-9cab-68292a4cc02a tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:26.743639 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bdecfea2-caa9-4e16-9cab-68292a4cc02a tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:26.744414 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bdecfea2-caa9-4e16-9cab-68292a4cc02a tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:26.744858 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bdecfea2-caa9-4e16-9cab-68292a4cc02a tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:26.779193 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bdecfea2-caa9-4e16-9cab-68292a4cc02a tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:26.779905 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bdecfea2-caa9-4e16-9cab-68292a4cc02a tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:26.780075 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-bdecfea2-caa9-4e16-9cab-68292a4cc02a tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lazy-loading 'fault' on Instance uuid daac6aee-3c43-42a7-ad5d-c24028e3ed27 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:07:26.830122 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-bdecfea2-caa9-4e16-9cab-68292a4cc02a tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:26.841948 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-bdecfea2-caa9-4e16-9cab-68292a4cc02a tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1304 microversion: 2.1 time: 0.107995 Feb 20 20:07:26.842953 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 263/508] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:26 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:27.282453 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4af9c4cc-3136-4f6c-89f6-31b5af30805f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:27.283794 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4af9c4cc-3136-4f6c-89f6-31b5af30805f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:27.291629 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4af9c4cc-3136-4f6c-89f6-31b5af30805f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:27.295901 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4af9c4cc-3136-4f6c-89f6-31b5af30805f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:27.295901 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4af9c4cc-3136-4f6c-89f6-31b5af30805f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:27.295901 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4af9c4cc-3136-4f6c-89f6-31b5af30805f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:27.594594 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4af9c4cc-3136-4f6c-89f6-31b5af30805f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:27.604876 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4af9c4cc-3136-4f6c-89f6-31b5af30805f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:27.607238 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4af9c4cc-3136-4f6c-89f6-31b5af30805f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:27.608518 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4af9c4cc-3136-4f6c-89f6-31b5af30805f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.332804 Feb 20 20:07:27.609497 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 246/509] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:27 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:07:27.861556 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9405b524-843b-4a34-84ef-974eb420f4a1 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:27.861556 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9405b524-843b-4a34-84ef-974eb420f4a1 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:27.873288 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9405b524-843b-4a34-84ef-974eb420f4a1 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:27.873770 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9405b524-843b-4a34-84ef-974eb420f4a1 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:27.874569 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9405b524-843b-4a34-84ef-974eb420f4a1 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:27.875002 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9405b524-843b-4a34-84ef-974eb420f4a1 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:27.911466 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9405b524-843b-4a34-84ef-974eb420f4a1 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:27.911997 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9405b524-843b-4a34-84ef-974eb420f4a1 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:27.912446 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-9405b524-843b-4a34-84ef-974eb420f4a1 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lazy-loading 'fault' on Instance uuid daac6aee-3c43-42a7-ad5d-c24028e3ed27 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:07:28.007047 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9405b524-843b-4a34-84ef-974eb420f4a1 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:28.024658 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9405b524-843b-4a34-84ef-974eb420f4a1 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1304 microversion: 2.1 time: 0.167240 Feb 20 20:07:28.026799 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 264/510] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:27 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1304 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:28.634130 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-90cb454f-b561-48a6-8c1d-248fd8dc8a7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:28.635744 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-90cb454f-b561-48a6-8c1d-248fd8dc8a7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:28.647853 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-90cb454f-b561-48a6-8c1d-248fd8dc8a7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:28.652264 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-90cb454f-b561-48a6-8c1d-248fd8dc8a7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:28.652264 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-90cb454f-b561-48a6-8c1d-248fd8dc8a7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:28.652264 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-90cb454f-b561-48a6-8c1d-248fd8dc8a7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:28.874134 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-90cb454f-b561-48a6-8c1d-248fd8dc8a7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:28.895000 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-90cb454f-b561-48a6-8c1d-248fd8dc8a7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:28.897852 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-90cb454f-b561-48a6-8c1d-248fd8dc8a7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:28.899738 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-90cb454f-b561-48a6-8c1d-248fd8dc8a7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.273720 Feb 20 20:07:28.900656 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 247/511] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:28 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:07:29.057391 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6fd5e6c1-89e8-4b4d-85c3-3aa6320a0faa tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:29.058445 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6fd5e6c1-89e8-4b4d-85c3-3aa6320a0faa tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:29.072774 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6fd5e6c1-89e8-4b4d-85c3-3aa6320a0faa tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:29.075687 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6fd5e6c1-89e8-4b4d-85c3-3aa6320a0faa tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:29.078017 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6fd5e6c1-89e8-4b4d-85c3-3aa6320a0faa tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:29.078756 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6fd5e6c1-89e8-4b4d-85c3-3aa6320a0faa tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:29.148083 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6fd5e6c1-89e8-4b4d-85c3-3aa6320a0faa tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:29.148535 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6fd5e6c1-89e8-4b4d-85c3-3aa6320a0faa tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:29.149468 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-6fd5e6c1-89e8-4b4d-85c3-3aa6320a0faa tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lazy-loading 'fault' on Instance uuid daac6aee-3c43-42a7-ad5d-c24028e3ed27 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:07:29.243278 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6fd5e6c1-89e8-4b4d-85c3-3aa6320a0faa tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d780561bcc8449ba44023470a01f733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da90cec6e9b24aeab219d95489ccb6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:29.255703 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6fd5e6c1-89e8-4b4d-85c3-3aa6320a0faa tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 200 len: 1304 microversion: 2.1 time: 0.207559 Feb 20 20:07:29.268911 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 265/512] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:29 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 1304 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:29.781942 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-c6b00163-69e2-469a-8c45-0545bf8a5500 req-d6fe6828-f5da-44b4-95bc-a89efb3b9eff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19d0359-a8b7-4b10-9423-86e7bc401f0b", "tag": "24ada99e-5acc-483e-9242-a2920061f997"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:07:29.784624 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:07:29.784624 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:07:29.795095 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-c6b00163-69e2-469a-8c45-0545bf8a5500 req-d6fe6828-f5da-44b4-95bc-a89efb3b9eff service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:29.795095 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-c6b00163-69e2-469a-8c45-0545bf8a5500 req-d6fe6828-f5da-44b4-95bc-a89efb3b9eff service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:29.807559 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-c6b00163-69e2-469a-8c45-0545bf8a5500 req-d6fe6828-f5da-44b4-95bc-a89efb3b9eff service nova] Creating event network-changed:24ada99e-5acc-483e-9242-a2920061f997 for instance e19d0359-a8b7-4b10-9423-86e7bc401f0b on hv-cinder-83008 Feb 20 20:07:29.817530 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-c6b00163-69e2-469a-8c45-0545bf8a5500 req-d6fe6828-f5da-44b4-95bc-a89efb3b9eff service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043653 Feb 20 20:07:29.822680 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 248/513] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:07:29.935629 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-084eef44-1a8a-40cc-9f44-e816e1dea44f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:29.937246 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-084eef44-1a8a-40cc-9f44-e816e1dea44f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:29.956225 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-084eef44-1a8a-40cc-9f44-e816e1dea44f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:29.957316 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-084eef44-1a8a-40cc-9f44-e816e1dea44f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:29.960233 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-084eef44-1a8a-40cc-9f44-e816e1dea44f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:29.961466 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-084eef44-1a8a-40cc-9f44-e816e1dea44f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:30.281469 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d1487fbd-3226-4a06-bee5-1a4a748a8cb4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:30.282485 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d1487fbd-3226-4a06-bee5-1a4a748a8cb4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] [instance: daac6aee-3c43-42a7-ad5d-c24028e3ed27] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:30.308531 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d1487fbd-3226-4a06-bee5-1a4a748a8cb4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:30.310585 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d1487fbd-3226-4a06-bee5-1a4a748a8cb4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:30.313927 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d1487fbd-3226-4a06-bee5-1a4a748a8cb4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:30.318073 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d1487fbd-3226-4a06-bee5-1a4a748a8cb4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:30.370236 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-d1487fbd-3226-4a06-bee5-1a4a748a8cb4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] HTTP exception thrown: Instance daac6aee-3c43-42a7-ad5d-c24028e3ed27 could not be found. Feb 20 20:07:30.373634 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d1487fbd-3226-4a06-bee5-1a4a748a8cb4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] Returning 404 to user: Instance daac6aee-3c43-42a7-ad5d-c24028e3ed27 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:07:30.374545 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d1487fbd-3226-4a06-bee5-1a4a748a8cb4 tempest-VolumesNegativeTest-796328655 tempest-VolumesNegativeTest-796328655-project] 10.222.0.60 "GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27" status: 404 len: 111 microversion: 2.1 time: 0.101189 Feb 20 20:07:30.377421 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 249/514] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:30 2022] GET /compute/v2.1/servers/daac6aee-3c43-42a7-ad5d-c24028e3ed27 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:07:30.510598 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-084eef44-1a8a-40cc-9f44-e816e1dea44f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:30.528528 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-084eef44-1a8a-40cc-9f44-e816e1dea44f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:30.536559 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-084eef44-1a8a-40cc-9f44-e816e1dea44f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:30.538805 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-084eef44-1a8a-40cc-9f44-e816e1dea44f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.610071 Feb 20 20:07:30.544608 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 266/515] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:29 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:07:31.406409 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6fd5e3e9-ad41-4334-b662-2d94b7133abf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:31.407536 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6fd5e3e9-ad41-4334-b662-2d94b7133abf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:31.416205 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6fd5e3e9-ad41-4334-b662-2d94b7133abf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:31.417011 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6fd5e3e9-ad41-4334-b662-2d94b7133abf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:31.418815 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6fd5e3e9-ad41-4334-b662-2d94b7133abf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:31.419449 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6fd5e3e9-ad41-4334-b662-2d94b7133abf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:31.472309 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6fd5e3e9-ad41-4334-b662-2d94b7133abf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Going to try to terminate instance {{(pid=117087) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 20 20:07:31.569731 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-01ebfafe-9266-43dc-a31a-e72954a8cfe0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:31.569731 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-01ebfafe-9266-43dc-a31a-e72954a8cfe0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:31.589038 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-01ebfafe-9266-43dc-a31a-e72954a8cfe0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:31.589524 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-01ebfafe-9266-43dc-a31a-e72954a8cfe0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:31.591822 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-01ebfafe-9266-43dc-a31a-e72954a8cfe0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:31.591822 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-01ebfafe-9266-43dc-a31a-e72954a8cfe0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:31.851799 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-01ebfafe-9266-43dc-a31a-e72954a8cfe0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:31.893027 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-01ebfafe-9266-43dc-a31a-e72954a8cfe0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:31.897743 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-01ebfafe-9266-43dc-a31a-e72954a8cfe0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:31.899358 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-01ebfafe-9266-43dc-a31a-e72954a8cfe0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.340399 Feb 20 20:07:31.900440 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 267/516] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:31 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:07:31.931884 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6fd5e3e9-ad41-4334-b662-2d94b7133abf tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "DELETE /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 204 len: 0 microversion: 2.1 time: 0.538467 Feb 20 20:07:31.932461 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 250/517] 10.222.0.60 () {58 vars in 1238 bytes} [Sun Feb 20 20:07:31 2022] DELETE /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 20 20:07:31.945430 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-30fc3ad1-2927-4a29-9d9b-61e423c7a515 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:31.946176 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-30fc3ad1-2927-4a29-9d9b-61e423c7a515 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:31.953577 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-30fc3ad1-2927-4a29-9d9b-61e423c7a515 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:31.954110 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-30fc3ad1-2927-4a29-9d9b-61e423c7a515 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:31.954960 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-30fc3ad1-2927-4a29-9d9b-61e423c7a515 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:31.955499 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-30fc3ad1-2927-4a29-9d9b-61e423c7a515 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:32.234637 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-30fc3ad1-2927-4a29-9d9b-61e423c7a515 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:32.249669 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-30fc3ad1-2927-4a29-9d9b-61e423c7a515 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1508 microversion: 2.1 time: 0.307287 Feb 20 20:07:32.250447 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 268/518] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:31 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1508 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:32.924585 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-09214279-16ec-43eb-ac78-4793d583aede tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:32.925986 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-09214279-16ec-43eb-ac78-4793d583aede tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:32.939563 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-09214279-16ec-43eb-ac78-4793d583aede tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:32.940163 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-09214279-16ec-43eb-ac78-4793d583aede tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:32.948070 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-09214279-16ec-43eb-ac78-4793d583aede tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:32.950165 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-09214279-16ec-43eb-ac78-4793d583aede tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:33.209046 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-09214279-16ec-43eb-ac78-4793d583aede tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:33.219356 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-09214279-16ec-43eb-ac78-4793d583aede tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:33.220948 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-09214279-16ec-43eb-ac78-4793d583aede tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:33.222680 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-09214279-16ec-43eb-ac78-4793d583aede tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.303484 Feb 20 20:07:33.223265 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 251/519] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:32 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:07:33.268792 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-04e36de7-6ffd-4d0b-bd5c-08e9bc0d8ab6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:33.269622 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-04e36de7-6ffd-4d0b-bd5c-08e9bc0d8ab6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:33.276725 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-04e36de7-6ffd-4d0b-bd5c-08e9bc0d8ab6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:33.277277 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-04e36de7-6ffd-4d0b-bd5c-08e9bc0d8ab6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:33.279225 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-04e36de7-6ffd-4d0b-bd5c-08e9bc0d8ab6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:33.279933 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-04e36de7-6ffd-4d0b-bd5c-08e9bc0d8ab6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:33.500404 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-04e36de7-6ffd-4d0b-bd5c-08e9bc0d8ab6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:33.513568 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-04e36de7-6ffd-4d0b-bd5c-08e9bc0d8ab6 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1508 microversion: 2.1 time: 0.248422 Feb 20 20:07:33.520229 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 269/520] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:33 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1508 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:34.143980 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-1e560adc-b820-4d50-847e-4058a8a7af8d req-020f2ea0-dceb-450c-a14f-09b60bc17807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97", "name": "network-vif-plugged", "status": "completed", "tag": "87a52ebd-35dd-4b56-8924-9578f176542c"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:07:34.150925 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:07:34.150925 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:07:34.165136 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-1e560adc-b820-4d50-847e-4058a8a7af8d req-020f2ea0-dceb-450c-a14f-09b60bc17807 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:34.165598 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-1e560adc-b820-4d50-847e-4058a8a7af8d req-020f2ea0-dceb-450c-a14f-09b60bc17807 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:34.196025 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-1e560adc-b820-4d50-847e-4058a8a7af8d req-020f2ea0-dceb-450c-a14f-09b60bc17807 service nova] Creating event network-vif-plugged:87a52ebd-35dd-4b56-8924-9578f176542c for instance d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 on hv-cinder-83008 Feb 20 20:07:34.206760 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-1e560adc-b820-4d50-847e-4058a8a7af8d req-020f2ea0-dceb-450c-a14f-09b60bc17807 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068715 Feb 20 20:07:34.207833 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 252/521] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:07:34.242374 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-479cd8b3-0274-4b4a-9bd4-c4f5685ae0ab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:34.244224 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-479cd8b3-0274-4b4a-9bd4-c4f5685ae0ab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:34.256571 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-479cd8b3-0274-4b4a-9bd4-c4f5685ae0ab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:34.257763 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-479cd8b3-0274-4b4a-9bd4-c4f5685ae0ab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:34.259372 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-479cd8b3-0274-4b4a-9bd4-c4f5685ae0ab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:34.260466 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-479cd8b3-0274-4b4a-9bd4-c4f5685ae0ab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:34.475796 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-479cd8b3-0274-4b4a-9bd4-c4f5685ae0ab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:34.488187 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-479cd8b3-0274-4b4a-9bd4-c4f5685ae0ab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:34.490216 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-479cd8b3-0274-4b4a-9bd4-c4f5685ae0ab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:34.491560 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-479cd8b3-0274-4b4a-9bd4-c4f5685ae0ab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.253482 Feb 20 20:07:34.492657 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 270/522] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:34 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:07:34.534428 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-86d2e908-ae00-4a99-b1dc-20f25e9b7e0b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:34.535267 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-86d2e908-ae00-4a99-b1dc-20f25e9b7e0b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:34.548513 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-86d2e908-ae00-4a99-b1dc-20f25e9b7e0b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:34.550094 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-86d2e908-ae00-4a99-b1dc-20f25e9b7e0b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:34.551457 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-86d2e908-ae00-4a99-b1dc-20f25e9b7e0b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:34.554230 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-86d2e908-ae00-4a99-b1dc-20f25e9b7e0b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:34.938998 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-86d2e908-ae00-4a99-b1dc-20f25e9b7e0b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:34.968147 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-86d2e908-ae00-4a99-b1dc-20f25e9b7e0b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1508 microversion: 2.1 time: 0.437972 Feb 20 20:07:34.969714 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 253/523] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:34 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1508 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:35.514247 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6f05cf68-5a59-48cf-a827-2a85482e508e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:35.515654 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6f05cf68-5a59-48cf-a827-2a85482e508e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:35.524040 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6f05cf68-5a59-48cf-a827-2a85482e508e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:35.525133 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6f05cf68-5a59-48cf-a827-2a85482e508e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:35.526492 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6f05cf68-5a59-48cf-a827-2a85482e508e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:35.527033 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6f05cf68-5a59-48cf-a827-2a85482e508e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:35.885716 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6f05cf68-5a59-48cf-a827-2a85482e508e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:35.901359 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6f05cf68-5a59-48cf-a827-2a85482e508e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:35.903896 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6f05cf68-5a59-48cf-a827-2a85482e508e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:35.905525 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6f05cf68-5a59-48cf-a827-2a85482e508e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.397515 Feb 20 20:07:35.906604 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 271/524] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:35 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:07:35.998842 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2b08c19e-dba9-426d-b6fa-f1a075038f64 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:36.000046 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2b08c19e-dba9-426d-b6fa-f1a075038f64 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:36.031427 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2b08c19e-dba9-426d-b6fa-f1a075038f64 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:36.031427 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2b08c19e-dba9-426d-b6fa-f1a075038f64 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:36.031824 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2b08c19e-dba9-426d-b6fa-f1a075038f64 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:36.032518 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2b08c19e-dba9-426d-b6fa-f1a075038f64 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:36.382182 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2b08c19e-dba9-426d-b6fa-f1a075038f64 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:36.400703 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2b08c19e-dba9-426d-b6fa-f1a075038f64 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1508 microversion: 2.1 time: 0.408483 Feb 20 20:07:36.401548 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 254/525] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:35 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1508 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:36.931727 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5e405695-6045-4fd1-a02c-8a6e1dcfd2a8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:36.933017 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5e405695-6045-4fd1-a02c-8a6e1dcfd2a8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:36.986474 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5e405695-6045-4fd1-a02c-8a6e1dcfd2a8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:36.989616 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5e405695-6045-4fd1-a02c-8a6e1dcfd2a8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:36.989616 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5e405695-6045-4fd1-a02c-8a6e1dcfd2a8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:36.989616 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5e405695-6045-4fd1-a02c-8a6e1dcfd2a8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:37.430349 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-26a18c1f-47bb-480d-af9e-bdf66f83384c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:37.432017 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-26a18c1f-47bb-480d-af9e-bdf66f83384c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:37.446724 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-26a18c1f-47bb-480d-af9e-bdf66f83384c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:37.447809 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-26a18c1f-47bb-480d-af9e-bdf66f83384c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:37.448632 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-26a18c1f-47bb-480d-af9e-bdf66f83384c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:37.449075 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-26a18c1f-47bb-480d-af9e-bdf66f83384c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:37.560837 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-26a18c1f-47bb-480d-af9e-bdf66f83384c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:37.594414 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-26a18c1f-47bb-480d-af9e-bdf66f83384c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1466 microversion: 2.1 time: 0.168254 Feb 20 20:07:37.596066 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 255/526] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:37 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1466 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:37.615551 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-43ff4b36-c631-4200-9e3f-3dc9bde3c2f7 req-cd5fb69d-14d4-4dfd-9084-a27eab050435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52443e14-8400-4a24-8928-b6c1ccd822a5", "name": "network-vif-deleted", "tag": "c6f9bc83-3d9c-4fbd-973e-18a908aadda3"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:07:37.619413 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:07:37.619413 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:07:37.635017 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-43ff4b36-c631-4200-9e3f-3dc9bde3c2f7 req-cd5fb69d-14d4-4dfd-9084-a27eab050435 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:37.635923 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-43ff4b36-c631-4200-9e3f-3dc9bde3c2f7 req-cd5fb69d-14d4-4dfd-9084-a27eab050435 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:37.661844 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5e405695-6045-4fd1-a02c-8a6e1dcfd2a8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:37.676209 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5e405695-6045-4fd1-a02c-8a6e1dcfd2a8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:37.677882 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5e405695-6045-4fd1-a02c-8a6e1dcfd2a8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:37.679229 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5e405695-6045-4fd1-a02c-8a6e1dcfd2a8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.757510 Feb 20 20:07:37.679805 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 272/527] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:36 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:07:37.701048 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-43ff4b36-c631-4200-9e3f-3dc9bde3c2f7 req-cd5fb69d-14d4-4dfd-9084-a27eab050435 service nova] Creating event network-vif-deleted:c6f9bc83-3d9c-4fbd-973e-18a908aadda3 for instance 52443e14-8400-4a24-8928-b6c1ccd822a5 on hv-cinder-83008 Feb 20 20:07:37.715661 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-43ff4b36-c631-4200-9e3f-3dc9bde3c2f7 req-cd5fb69d-14d4-4dfd-9084-a27eab050435 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111896 Feb 20 20:07:37.716416 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 256/528] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:07:38.617336 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d6a018b7-c17e-483a-a18f-29da281d7102 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:38.619103 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d6a018b7-c17e-483a-a18f-29da281d7102 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:38.627213 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d6a018b7-c17e-483a-a18f-29da281d7102 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:38.627815 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d6a018b7-c17e-483a-a18f-29da281d7102 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:38.629165 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d6a018b7-c17e-483a-a18f-29da281d7102 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:38.629637 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d6a018b7-c17e-483a-a18f-29da281d7102 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:38.695102 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d6a018b7-c17e-483a-a18f-29da281d7102 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:38.695102 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d6a018b7-c17e-483a-a18f-29da281d7102 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:38.695102 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-d6a018b7-c17e-483a-a18f-29da281d7102 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lazy-loading 'fault' on Instance uuid 52443e14-8400-4a24-8928-b6c1ccd822a5 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:07:38.700712 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-75685465-5aed-4cd7-ad2a-2940fad14706 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:38.701676 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-75685465-5aed-4cd7-ad2a-2940fad14706 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:38.720243 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-75685465-5aed-4cd7-ad2a-2940fad14706 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:38.723697 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-75685465-5aed-4cd7-ad2a-2940fad14706 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:38.723697 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-75685465-5aed-4cd7-ad2a-2940fad14706 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:38.723697 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-75685465-5aed-4cd7-ad2a-2940fad14706 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:38.835893 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d6a018b7-c17e-483a-a18f-29da281d7102 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:38.868723 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d6a018b7-c17e-483a-a18f-29da281d7102 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 200 len: 1311 microversion: 2.1 time: 0.254135 Feb 20 20:07:38.870070 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 273/529] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:38 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 1311 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:07:39.032813 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-75685465-5aed-4cd7-ad2a-2940fad14706 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:39.049193 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-75685465-5aed-4cd7-ad2a-2940fad14706 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:39.052243 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-75685465-5aed-4cd7-ad2a-2940fad14706 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:39.054386 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-75685465-5aed-4cd7-ad2a-2940fad14706 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1811 microversion: 2.20 time: 0.359438 Feb 20 20:07:39.055870 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 257/530] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:38 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1811 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:07:39.888059 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a0b8c3c5-920a-4876-8bf4-27c70e0f7d2d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:39.888932 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a0b8c3c5-920a-4876-8bf4-27c70e0f7d2d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 52443e14-8400-4a24-8928-b6c1ccd822a5] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:39.897724 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a0b8c3c5-920a-4876-8bf4-27c70e0f7d2d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:39.898163 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a0b8c3c5-920a-4876-8bf4-27c70e0f7d2d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:39.899171 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a0b8c3c5-920a-4876-8bf4-27c70e0f7d2d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:39.899757 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a0b8c3c5-920a-4876-8bf4-27c70e0f7d2d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:39.928677 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-a0b8c3c5-920a-4876-8bf4-27c70e0f7d2d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] HTTP exception thrown: Instance 52443e14-8400-4a24-8928-b6c1ccd822a5 could not be found. Feb 20 20:07:39.929705 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a0b8c3c5-920a-4876-8bf4-27c70e0f7d2d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Returning 404 to user: Instance 52443e14-8400-4a24-8928-b6c1ccd822a5 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:07:39.931839 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a0b8c3c5-920a-4876-8bf4-27c70e0f7d2d tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5" status: 404 len: 111 microversion: 2.1 time: 0.047450 Feb 20 20:07:39.932281 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 274/531] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:39 2022] GET /compute/v2.1/servers/52443e14-8400-4a24-8928-b6c1ccd822a5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 20 20:07:39.946159 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5ede731a-76bb-4a47-af79-506102b724e4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:39.946867 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5ede731a-76bb-4a47-af79-506102b724e4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:39.960353 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5ede731a-76bb-4a47-af79-506102b724e4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:39.960812 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5ede731a-76bb-4a47-af79-506102b724e4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:39.962188 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5ede731a-76bb-4a47-af79-506102b724e4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:39.963052 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5ede731a-76bb-4a47-af79-506102b724e4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:40.029199 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5ede731a-76bb-4a47-af79-506102b724e4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Going to try to terminate instance {{(pid=117087) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 20 20:07:40.074169 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-76e5111c-0799-4abf-ae95-91451730f64f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:40.075428 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-76e5111c-0799-4abf-ae95-91451730f64f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:40.082089 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-76e5111c-0799-4abf-ae95-91451730f64f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:40.087499 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-76e5111c-0799-4abf-ae95-91451730f64f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:40.089779 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-76e5111c-0799-4abf-ae95-91451730f64f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:40.091105 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-76e5111c-0799-4abf-ae95-91451730f64f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:40.313270 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-76e5111c-0799-4abf-ae95-91451730f64f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:40.322011 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-76e5111c-0799-4abf-ae95-91451730f64f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:40.323665 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-76e5111c-0799-4abf-ae95-91451730f64f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:40.325193 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-76e5111c-0799-4abf-ae95-91451730f64f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1798 microversion: 2.20 time: 0.254880 Feb 20 20:07:40.325934 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 275/532] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:07:40 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1798 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:07:40.398341 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5ede731a-76bb-4a47-af79-506102b724e4 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 204 len: 0 microversion: 2.1 time: 0.458571 Feb 20 20:07:40.399082 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 258/533] 10.222.0.60 () {58 vars in 1238 bytes} [Sun Feb 20 20:07:39 2022] DELETE /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 20 20:07:40.414464 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3bdd1756-9bcf-4936-929e-1a12bb93a72c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:40.416128 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-3bdd1756-9bcf-4936-929e-1a12bb93a72c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:40.434236 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3bdd1756-9bcf-4936-929e-1a12bb93a72c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:40.435223 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3bdd1756-9bcf-4936-929e-1a12bb93a72c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:40.436326 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3bdd1756-9bcf-4936-929e-1a12bb93a72c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:40.437485 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3bdd1756-9bcf-4936-929e-1a12bb93a72c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:40.712828 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3bdd1756-9bcf-4936-929e-1a12bb93a72c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:40.726263 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-3bdd1756-9bcf-4936-929e-1a12bb93a72c tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.321821 Feb 20 20:07:40.737277 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 276/534] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:40 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:07:41.754121 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-45c88a7c-5080-4ce6-b0f4-b910b4dd2f23 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:41.755265 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-45c88a7c-5080-4ce6-b0f4-b910b4dd2f23 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:41.763062 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-45c88a7c-5080-4ce6-b0f4-b910b4dd2f23 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:41.764191 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-45c88a7c-5080-4ce6-b0f4-b910b4dd2f23 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:41.764835 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-45c88a7c-5080-4ce6-b0f4-b910b4dd2f23 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:41.765560 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-45c88a7c-5080-4ce6-b0f4-b910b4dd2f23 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:42.138762 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-45c88a7c-5080-4ce6-b0f4-b910b4dd2f23 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:42.149992 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-45c88a7c-5080-4ce6-b0f4-b910b4dd2f23 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.405535 Feb 20 20:07:42.150923 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 259/535] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:41 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:43.182425 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b248d00d-71e0-455a-9bb1-31f4a1e1db06 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:43.183493 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b248d00d-71e0-455a-9bb1-31f4a1e1db06 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:43.194245 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b248d00d-71e0-455a-9bb1-31f4a1e1db06 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:43.195464 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b248d00d-71e0-455a-9bb1-31f4a1e1db06 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:43.196942 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b248d00d-71e0-455a-9bb1-31f4a1e1db06 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:43.198016 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b248d00d-71e0-455a-9bb1-31f4a1e1db06 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:43.492558 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b248d00d-71e0-455a-9bb1-31f4a1e1db06 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:43.516153 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b248d00d-71e0-455a-9bb1-31f4a1e1db06 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.340240 Feb 20 20:07:43.522009 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 277/536] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:43 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:44.575487 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b4e1135a-c8f4-42fc-9688-48b721b380b1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:44.580689 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b4e1135a-c8f4-42fc-9688-48b721b380b1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:44.599141 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b4e1135a-c8f4-42fc-9688-48b721b380b1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:44.599589 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b4e1135a-c8f4-42fc-9688-48b721b380b1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:44.601031 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b4e1135a-c8f4-42fc-9688-48b721b380b1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:44.601814 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b4e1135a-c8f4-42fc-9688-48b721b380b1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:44.891176 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b4e1135a-c8f4-42fc-9688-48b721b380b1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:44.907450 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b4e1135a-c8f4-42fc-9688-48b721b380b1 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.367910 Feb 20 20:07:44.909996 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 260/537] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:44 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:45.927910 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-30e2536a-6793-4567-8f89-8dbdf74ce76b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:45.928974 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-30e2536a-6793-4567-8f89-8dbdf74ce76b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:45.938770 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-30e2536a-6793-4567-8f89-8dbdf74ce76b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:45.940016 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-30e2536a-6793-4567-8f89-8dbdf74ce76b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:45.940846 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-30e2536a-6793-4567-8f89-8dbdf74ce76b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:45.941314 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-30e2536a-6793-4567-8f89-8dbdf74ce76b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:46.159705 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4da079f4-a147-46d3-977f-873603b8ac87 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:46.160800 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4da079f4-a147-46d3-977f-873603b8ac87 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:46.167896 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4da079f4-a147-46d3-977f-873603b8ac87 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:46.169312 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4da079f4-a147-46d3-977f-873603b8ac87 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:46.170513 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4da079f4-a147-46d3-977f-873603b8ac87 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:46.171339 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4da079f4-a147-46d3-977f-873603b8ac87 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:46.317997 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-30e2536a-6793-4567-8f89-8dbdf74ce76b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:46.327722 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-30e2536a-6793-4567-8f89-8dbdf74ce76b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.403570 Feb 20 20:07:46.328609 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 278/538] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:45 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:46.336100 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-4da079f4-a147-46d3-977f-873603b8ac87 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lazy-loading 'services' on Instance uuid ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:07:46.596891 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4da079f4-a147-46d3-977f-873603b8ac87 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6/os-volume_attachments/c4dd7191-332c-4707-a7ee-535af5d52cc2" status: 202 len: 0 microversion: 2.1 time: 0.440808 Feb 20 20:07:46.598869 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 261/539] 10.222.0.60 () {58 vars in 1415 bytes} [Sun Feb 20 20:07:46 2022] DELETE /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6/os-volume_attachments/c4dd7191-332c-4707-a7ee-535af5d52cc2 => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:07:46.985909 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-56b94e30-8c70-49fe-9d86-01c5f6a3724b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Action: 'create', calling method: .version_select at 0x7fdd915bc8b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-640523116"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:07:47.006106 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-56b94e30-8c70-49fe-9d86-01c5f6a3724b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Getting quotas for project 7d15dcb9692c401e9d0e06361839bb8b. Resources: {'key_pairs'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:07:47.010364 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-56b94e30-8c70-49fe-9d86-01c5f6a3724b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Getting quotas for user 62b3136320e64532991e5dd5a199e4d8 and project 7d15dcb9692c401e9d0e06361839bb8b. Resources: {'key_pairs'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:07:47.285163 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-56b94e30-8c70-49fe-9d86-01c5f6a3724b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Getting quotas for project 7d15dcb9692c401e9d0e06361839bb8b. Resources: {'key_pairs'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:07:47.290175 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-56b94e30-8c70-49fe-9d86-01c5f6a3724b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Getting quotas for user 62b3136320e64532991e5dd5a199e4d8 and project 7d15dcb9692c401e9d0e06361839bb8b. Resources: {'key_pairs'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:07:47.312397 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-56b94e30-8c70-49fe-9d86-01c5f6a3724b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.588228 Feb 20 20:07:47.317445 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 279/540] 10.222.0.60 () {60 vars in 1157 bytes} [Sun Feb 20 20:07:46 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:47.347837 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-80c9af5c-24bd-49fd-8612-1d984e69ed1b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:47.348989 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-80c9af5c-24bd-49fd-8612-1d984e69ed1b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:47.356333 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-80c9af5c-24bd-49fd-8612-1d984e69ed1b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:47.362861 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-80c9af5c-24bd-49fd-8612-1d984e69ed1b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:47.362861 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-80c9af5c-24bd-49fd-8612-1d984e69ed1b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:47.362861 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-80c9af5c-24bd-49fd-8612-1d984e69ed1b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:48.037435 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-80c9af5c-24bd-49fd-8612-1d984e69ed1b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:48.049195 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-80c9af5c-24bd-49fd-8612-1d984e69ed1b tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1522 microversion: 2.1 time: 0.705841 Feb 20 20:07:48.060823 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 262/541] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:47 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1522 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:48.906475 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-cfa39139-59b4-47ec-a959-1cda4f3f15d6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:07:48.909606 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-2a27a93e-ca25-452f-b9f9-6a8c077263fb req-4fac8fdc-8e87-45a7-a4b8-0ea85b5fd4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e394c2c-f9ca-4e79-9a43-f6a04f887f71", "name": "network-vif-deleted", "tag": "93f93cb7-06aa-4758-87e2-1a0fb13262c4"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:07:48.913119 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:07:48.913119 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:07:48.928551 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cfa39139-59b4-47ec-a959-1cda4f3f15d6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:48.930070 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cfa39139-59b4-47ec-a959-1cda4f3f15d6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:48.937348 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-2a27a93e-ca25-452f-b9f9-6a8c077263fb req-4fac8fdc-8e87-45a7-a4b8-0ea85b5fd4b0 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:48.941727 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-2a27a93e-ca25-452f-b9f9-6a8c077263fb req-4fac8fdc-8e87-45a7-a4b8-0ea85b5fd4b0 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:48.970311 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-2a27a93e-ca25-452f-b9f9-6a8c077263fb req-4fac8fdc-8e87-45a7-a4b8-0ea85b5fd4b0 service nova] Creating event network-vif-deleted:93f93cb7-06aa-4758-87e2-1a0fb13262c4 for instance 6e394c2c-f9ca-4e79-9a43-f6a04f887f71 on hv-cinder-83008 Feb 20 20:07:48.981749 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-2a27a93e-ca25-452f-b9f9-6a8c077263fb req-4fac8fdc-8e87-45a7-a4b8-0ea85b5fd4b0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086509 Feb 20 20:07:48.985198 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 280/542] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:07:48.993542 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-cfa39139-59b4-47ec-a959-1cda4f3f15d6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Going to try to stop instance {{(pid=117087) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 20 20:07:49.072826 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6ba141fc-af51-403f-965c-e97cafd80f22 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:49.073591 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6ba141fc-af51-403f-965c-e97cafd80f22 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:49.085058 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6ba141fc-af51-403f-965c-e97cafd80f22 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:49.086130 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6ba141fc-af51-403f-965c-e97cafd80f22 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:49.086943 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6ba141fc-af51-403f-965c-e97cafd80f22 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:49.087672 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6ba141fc-af51-403f-965c-e97cafd80f22 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:49.201870 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6ba141fc-af51-403f-965c-e97cafd80f22 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:49.212976 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6ba141fc-af51-403f-965c-e97cafd80f22 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1480 microversion: 2.1 time: 0.144254 Feb 20 20:07:49.213881 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 281/543] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:49 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1480 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:07:49.373545 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-cfa39139-59b4-47ec-a959-1cda4f3f15d6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "POST /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6/action" status: 202 len: 0 microversion: 2.1 time: 0.442826 Feb 20 20:07:49.373545 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 263/544] 10.222.0.60 () {60 vars in 1277 bytes} [Sun Feb 20 20:07:48 2022] POST /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:07:49.373712 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7ab34543-19b4-4f97-96e7-63194ee33083 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:49.373712 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7ab34543-19b4-4f97-96e7-63194ee33083 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:49.373712 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7ab34543-19b4-4f97-96e7-63194ee33083 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:49.373712 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7ab34543-19b4-4f97-96e7-63194ee33083 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:49.374020 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7ab34543-19b4-4f97-96e7-63194ee33083 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:49.374020 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7ab34543-19b4-4f97-96e7-63194ee33083 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:49.584851 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7ab34543-19b4-4f97-96e7-63194ee33083 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:49.593431 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7ab34543-19b4-4f97-96e7-63194ee33083 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1675 microversion: 2.1 time: 0.240790 Feb 20 20:07:49.595318 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 282/545] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:49 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1675 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:50.233962 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7d617aa5-4fe8-41d6-828e-2a75861266e9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:50.234731 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7d617aa5-4fe8-41d6-828e-2a75861266e9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:50.243873 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7d617aa5-4fe8-41d6-828e-2a75861266e9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:50.245757 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7d617aa5-4fe8-41d6-828e-2a75861266e9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:50.245757 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7d617aa5-4fe8-41d6-828e-2a75861266e9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:50.246529 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7d617aa5-4fe8-41d6-828e-2a75861266e9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:50.297820 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7d617aa5-4fe8-41d6-828e-2a75861266e9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:50.298276 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7d617aa5-4fe8-41d6-828e-2a75861266e9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:50.298841 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-7d617aa5-4fe8-41d6-828e-2a75861266e9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lazy-loading 'fault' on Instance uuid 6e394c2c-f9ca-4e79-9a43-f6a04f887f71 {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:07:50.367006 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7d617aa5-4fe8-41d6-828e-2a75861266e9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c704da343000437aa514b8f807c1f2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c41f18c6d374064a28ac5b75141a0d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:50.434712 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7d617aa5-4fe8-41d6-828e-2a75861266e9 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 200 len: 1312 microversion: 2.1 time: 0.205468 Feb 20 20:07:50.441307 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 264/546] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:50 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 1312 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:50.626068 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b2bf695d-b616-40bd-a276-53b568c5ecac tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:50.628071 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b2bf695d-b616-40bd-a276-53b568c5ecac tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:50.656100 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b2bf695d-b616-40bd-a276-53b568c5ecac tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:50.656697 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b2bf695d-b616-40bd-a276-53b568c5ecac tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:50.658079 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b2bf695d-b616-40bd-a276-53b568c5ecac tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:50.658702 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b2bf695d-b616-40bd-a276-53b568c5ecac tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:50.914680 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b2bf695d-b616-40bd-a276-53b568c5ecac tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:50.929783 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b2bf695d-b616-40bd-a276-53b568c5ecac tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1675 microversion: 2.1 time: 0.310067 Feb 20 20:07:50.931271 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 283/547] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:50 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1675 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:51.469205 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ada883b5-63a4-4db5-989f-facc349750d2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:51.470770 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ada883b5-63a4-4db5-989f-facc349750d2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] [instance: 6e394c2c-f9ca-4e79-9a43-f6a04f887f71] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:51.479172 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ada883b5-63a4-4db5-989f-facc349750d2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:51.480020 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ada883b5-63a4-4db5-989f-facc349750d2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:51.481916 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ada883b5-63a4-4db5-989f-facc349750d2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:51.482378 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ada883b5-63a4-4db5-989f-facc349750d2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:51.504659 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-ada883b5-63a4-4db5-989f-facc349750d2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] HTTP exception thrown: Instance 6e394c2c-f9ca-4e79-9a43-f6a04f887f71 could not be found. Feb 20 20:07:51.505679 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ada883b5-63a4-4db5-989f-facc349750d2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] Returning 404 to user: Instance 6e394c2c-f9ca-4e79-9a43-f6a04f887f71 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:07:51.506524 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ada883b5-63a4-4db5-989f-facc349750d2 tempest-ServerRescueNegativeTestJSON-417936354 tempest-ServerRescueNegativeTestJSON-417936354-project] 10.222.0.60 "GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71" status: 404 len: 111 microversion: 2.1 time: 0.045328 Feb 20 20:07:51.507309 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 265/548] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:51 2022] GET /compute/v2.1/servers/6e394c2c-f9ca-4e79-9a43-f6a04f887f71 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:07:51.953577 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-915fedd4-e2ba-4273-83c0-9122cc70812f tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:51.965379 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-915fedd4-e2ba-4273-83c0-9122cc70812f tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:51.965379 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-915fedd4-e2ba-4273-83c0-9122cc70812f tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:51.965379 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-915fedd4-e2ba-4273-83c0-9122cc70812f tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:51.965379 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-915fedd4-e2ba-4273-83c0-9122cc70812f tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:51.965888 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-915fedd4-e2ba-4273-83c0-9122cc70812f tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:52.268282 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-915fedd4-e2ba-4273-83c0-9122cc70812f tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:52.278808 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-915fedd4-e2ba-4273-83c0-9122cc70812f tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1675 microversion: 2.1 time: 0.329704 Feb 20 20:07:52.280094 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 284/549] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:51 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1675 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:07:53.312205 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-419d3e28-8f8d-4806-865b-313939a81240 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:53.313230 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-419d3e28-8f8d-4806-865b-313939a81240 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:53.320865 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-419d3e28-8f8d-4806-865b-313939a81240 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:53.321448 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-419d3e28-8f8d-4806-865b-313939a81240 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:53.322305 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-419d3e28-8f8d-4806-865b-313939a81240 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:53.322866 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-419d3e28-8f8d-4806-865b-313939a81240 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:53.879222 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-419d3e28-8f8d-4806-865b-313939a81240 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:53.888055 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-419d3e28-8f8d-4806-865b-313939a81240 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1675 microversion: 2.1 time: 0.583392 Feb 20 20:07:53.888753 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 266/550] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:53 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1675 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:54.907118 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4ae1bc2d-ce6b-4e90-9342-06410133ba05 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:54.907735 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4ae1bc2d-ce6b-4e90-9342-06410133ba05 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:54.915090 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ae1bc2d-ce6b-4e90-9342-06410133ba05 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:54.915533 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ae1bc2d-ce6b-4e90-9342-06410133ba05 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:54.916324 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ae1bc2d-ce6b-4e90-9342-06410133ba05 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:54.916755 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ae1bc2d-ce6b-4e90-9342-06410133ba05 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:55.090142 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4ae1bc2d-ce6b-4e90-9342-06410133ba05 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:55.099311 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4ae1bc2d-ce6b-4e90-9342-06410133ba05 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1675 microversion: 2.1 time: 0.196362 Feb 20 20:07:55.109559 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 285/551] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:54 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1675 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:56.117853 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-992602ef-eb17-4abf-a675-fcfddec4e22c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:56.118810 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-992602ef-eb17-4abf-a675-fcfddec4e22c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:56.128274 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-992602ef-eb17-4abf-a675-fcfddec4e22c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:56.128727 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-992602ef-eb17-4abf-a675-fcfddec4e22c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:56.129778 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-992602ef-eb17-4abf-a675-fcfddec4e22c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:56.130218 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-992602ef-eb17-4abf-a675-fcfddec4e22c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:56.326498 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-992602ef-eb17-4abf-a675-fcfddec4e22c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:56.335537 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-992602ef-eb17-4abf-a675-fcfddec4e22c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1675 microversion: 2.1 time: 0.221951 Feb 20 20:07:56.336129 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 267/552] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:56 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1675 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:07:57.358677 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2eb28324-6fef-41e7-9a5a-7fe4036133ac tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:57.360385 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2eb28324-6fef-41e7-9a5a-7fe4036133ac tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:57.371778 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2eb28324-6fef-41e7-9a5a-7fe4036133ac tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:57.372495 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2eb28324-6fef-41e7-9a5a-7fe4036133ac tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:57.373544 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2eb28324-6fef-41e7-9a5a-7fe4036133ac tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:57.374117 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2eb28324-6fef-41e7-9a5a-7fe4036133ac tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:57.562107 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2eb28324-6fef-41e7-9a5a-7fe4036133ac tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:57.570438 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2eb28324-6fef-41e7-9a5a-7fe4036133ac tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1675 microversion: 2.1 time: 0.218434 Feb 20 20:07:57.591737 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 286/553] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:57 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1675 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:58.589234 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-153ec612-5208-4e65-946b-e09620d2ff44 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:58.590743 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-153ec612-5208-4e65-946b-e09620d2ff44 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:58.597980 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-153ec612-5208-4e65-946b-e09620d2ff44 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:58.598670 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-153ec612-5208-4e65-946b-e09620d2ff44 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:58.599549 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-153ec612-5208-4e65-946b-e09620d2ff44 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:58.599994 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-153ec612-5208-4e65-946b-e09620d2ff44 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:58.778542 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-153ec612-5208-4e65-946b-e09620d2ff44 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:07:58.786526 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-153ec612-5208-4e65-946b-e09620d2ff44 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1675 microversion: 2.1 time: 0.201006 Feb 20 20:07:58.787295 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 268/554] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:58 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1675 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:07:59.808221 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e1917978-e9cd-48dd-8484-d837fcef5b3f tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:07:59.810400 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e1917978-e9cd-48dd-8484-d837fcef5b3f tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:07:59.818152 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e1917978-e9cd-48dd-8484-d837fcef5b3f tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:59.818599 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e1917978-e9cd-48dd-8484-d837fcef5b3f tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:07:59.819473 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e1917978-e9cd-48dd-8484-d837fcef5b3f tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:07:59.820139 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e1917978-e9cd-48dd-8484-d837fcef5b3f tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:00.039919 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e1917978-e9cd-48dd-8484-d837fcef5b3f tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:00.051397 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e1917978-e9cd-48dd-8484-d837fcef5b3f tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1675 microversion: 2.1 time: 0.249060 Feb 20 20:08:00.052230 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 287/555] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:07:59 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1675 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:00.613179 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3d056464-d377-484b-9bb9-f284cf2e260a tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1031460657", "imageRef": "61c0cc70-53e3-40ed-b353-ec1b5fc4eea4", "flavorRef": "452", "networks": [{"uuid": "8b2a19f4-c94f-444f-9511-f39cc6853442"}]}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:08:00.676727 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.network.neutron [None req-3d056464-d377-484b-9bb9-f284cf2e260a tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] validate_networks() for [('8b2a19f4-c94f-444f-9511-f39cc6853442', None, None, None, None, None)] {{(pid=117087) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 20 20:08:01.075149 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c9ba9837-ba4f-4449-8405-6f3ec8ed961c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:01.076269 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c9ba9837-ba4f-4449-8405-6f3ec8ed961c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:01.084916 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c9ba9837-ba4f-4449-8405-6f3ec8ed961c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:01.085858 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c9ba9837-ba4f-4449-8405-6f3ec8ed961c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:01.087105 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c9ba9837-ba4f-4449-8405-6f3ec8ed961c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:01.087960 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c9ba9837-ba4f-4449-8405-6f3ec8ed961c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:01.206513 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-3d056464-d377-484b-9bb9-f284cf2e260a tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Flavor limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 20 20:08:01.207606 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-3d056464-d377-484b-9bb9-f284cf2e260a tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Image limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 20 20:08:01.209930 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-3d056464-d377-484b-9bb9-f284cf2e260a tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Flavor pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 20 20:08:01.210959 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-3d056464-d377-484b-9bb9-f284cf2e260a tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Image pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 20 20:08:01.211980 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-3d056464-d377-484b-9bb9-f284cf2e260a tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 20 20:08:01.224875 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3d056464-d377-484b-9bb9-f284cf2e260a tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:01.225363 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3d056464-d377-484b-9bb9-f284cf2e260a tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:01.226185 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3d056464-d377-484b-9bb9-f284cf2e260a tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:01.226623 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3d056464-d377-484b-9bb9-f284cf2e260a tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:01.246512 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-3d056464-d377-484b-9bb9-f284cf2e260a tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Getting quotas for project 79884d2db8f34ea3a56bb24700c0834b. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:08:01.251701 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-3d056464-d377-484b-9bb9-f284cf2e260a tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Getting quotas for user 3c74b25bf2e94447ab74a7e157eadac7 and project 79884d2db8f34ea3a56bb24700c0834b. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:08:01.268933 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3d056464-d377-484b-9bb9-f284cf2e260a tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Going to run 1 instances... {{(pid=117087) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 20 20:08:01.274405 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3d056464-d377-484b-9bb9-f284cf2e260a tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61c0cc70-53e3-40ed-b353-ec1b5fc4eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 20 20:08:01.337623 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c9ba9837-ba4f-4449-8405-6f3ec8ed961c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:01.349925 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c9ba9837-ba4f-4449-8405-6f3ec8ed961c tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1652 microversion: 2.1 time: 0.280354 Feb 20 20:08:01.350967 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 288/556] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:01 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1652 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:01.378418 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-217cfb08-fa1f-4544-8220-cadbfa21b7c8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:08:01.390033 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-217cfb08-fa1f-4544-8220-cadbfa21b7c8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:01.390881 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-217cfb08-fa1f-4544-8220-cadbfa21b7c8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:01.419284 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-217cfb08-fa1f-4544-8220-cadbfa21b7c8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Going to try to start instance {{(pid=117088) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 20 20:08:01.447917 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3d056464-d377-484b-9bb9-f284cf2e260a tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.007212 Feb 20 20:08:01.448701 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 269/557] 10.222.0.60 () {60 vars in 1146 bytes} [Sun Feb 20 20:08:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 20 20:08:01.463513 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-707f61ad-3966-411b-8408-7f5b1764fc9e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:01.464928 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-707f61ad-3966-411b-8408-7f5b1764fc9e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:01.551258 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-707f61ad-3966-411b-8408-7f5b1764fc9e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:01.561173 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-707f61ad-3966-411b-8408-7f5b1764fc9e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403" status: 200 len: 1218 microversion: 2.1 time: 0.105065 Feb 20 20:08:01.563559 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 270/558] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:01 2022] GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:08:01.649857 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-217cfb08-fa1f-4544-8220-cadbfa21b7c8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "POST /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6/action" status: 202 len: 0 microversion: 2.1 time: 0.278684 Feb 20 20:08:01.650490 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 289/559] 10.222.0.60 () {60 vars in 1277 bytes} [Sun Feb 20 20:08:01 2022] POST /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:08:01.659408 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-97c923a6-8e82-4503-abd6-b38dcc44d042 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:01.660081 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-97c923a6-8e82-4503-abd6-b38dcc44d042 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:01.667182 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-97c923a6-8e82-4503-abd6-b38dcc44d042 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:01.668004 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-97c923a6-8e82-4503-abd6-b38dcc44d042 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:01.668972 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-97c923a6-8e82-4503-abd6-b38dcc44d042 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:01.669533 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-97c923a6-8e82-4503-abd6-b38dcc44d042 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:01.913943 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-97c923a6-8e82-4503-abd6-b38dcc44d042 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:01.923923 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-97c923a6-8e82-4503-abd6-b38dcc44d042 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1661 microversion: 2.1 time: 0.267999 Feb 20 20:08:01.925013 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 271/560] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:01 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1661 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:02.582493 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-af3acb2c-371c-4e0e-9f47-4348a3b32afd tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:02.583340 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-af3acb2c-371c-4e0e-9f47-4348a3b32afd tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:02.654232 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-af3acb2c-371c-4e0e-9f47-4348a3b32afd tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:02.662350 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-af3acb2c-371c-4e0e-9f47-4348a3b32afd tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403" status: 200 len: 1218 microversion: 2.1 time: 0.084269 Feb 20 20:08:02.663333 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 290/561] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:02 2022] GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:08:02.948320 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-57368031-8ed4-41bb-92d0-1f98049f2a2e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:02.949467 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-57368031-8ed4-41bb-92d0-1f98049f2a2e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:02.959282 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-57368031-8ed4-41bb-92d0-1f98049f2a2e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:02.960085 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-57368031-8ed4-41bb-92d0-1f98049f2a2e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:02.961528 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-57368031-8ed4-41bb-92d0-1f98049f2a2e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:02.962309 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-57368031-8ed4-41bb-92d0-1f98049f2a2e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:03.141445 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-57368031-8ed4-41bb-92d0-1f98049f2a2e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:03.149972 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-57368031-8ed4-41bb-92d0-1f98049f2a2e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1661 microversion: 2.1 time: 0.205389 Feb 20 20:08:03.150859 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 272/562] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:02 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1661 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:08:03.690910 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ab97523f-e9b9-4719-be88-a42fdc8cbfb0 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:03.692000 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ab97523f-e9b9-4719-be88-a42fdc8cbfb0 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:03.704962 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ab97523f-e9b9-4719-be88-a42fdc8cbfb0 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:03.705804 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ab97523f-e9b9-4719-be88-a42fdc8cbfb0 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:03.707168 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ab97523f-e9b9-4719-be88-a42fdc8cbfb0 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:03.707916 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ab97523f-e9b9-4719-be88-a42fdc8cbfb0 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:03.790866 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ab97523f-e9b9-4719-be88-a42fdc8cbfb0 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:03.803167 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ab97523f-e9b9-4719-be88-a42fdc8cbfb0 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403" status: 200 len: 1270 microversion: 2.1 time: 0.119139 Feb 20 20:08:03.804158 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 291/563] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:03 2022] GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 => generated 1270 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:04.176564 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6c0d6f71-ace1-49dd-809e-2bb1dbdc2e9e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:04.177430 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6c0d6f71-ace1-49dd-809e-2bb1dbdc2e9e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:04.186095 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6c0d6f71-ace1-49dd-809e-2bb1dbdc2e9e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:04.186545 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6c0d6f71-ace1-49dd-809e-2bb1dbdc2e9e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:04.187336 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6c0d6f71-ace1-49dd-809e-2bb1dbdc2e9e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:04.187770 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6c0d6f71-ace1-49dd-809e-2bb1dbdc2e9e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:04.349799 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6c0d6f71-ace1-49dd-809e-2bb1dbdc2e9e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:04.358610 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6c0d6f71-ace1-49dd-809e-2bb1dbdc2e9e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1665 microversion: 2.1 time: 0.188135 Feb 20 20:08:04.359203 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 273/564] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:04 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1665 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:04.824806 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e5ee99a7-5e87-4bc2-a674-14abb63d8b69 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:04.825698 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e5ee99a7-5e87-4bc2-a674-14abb63d8b69 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:04.836594 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e5ee99a7-5e87-4bc2-a674-14abb63d8b69 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:04.837455 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e5ee99a7-5e87-4bc2-a674-14abb63d8b69 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:04.838924 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e5ee99a7-5e87-4bc2-a674-14abb63d8b69 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:04.839723 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e5ee99a7-5e87-4bc2-a674-14abb63d8b69 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:04.924875 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e5ee99a7-5e87-4bc2-a674-14abb63d8b69 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:04.933285 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e5ee99a7-5e87-4bc2-a674-14abb63d8b69 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403" status: 200 len: 1288 microversion: 2.1 time: 0.112859 Feb 20 20:08:04.933884 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 292/565] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:04 2022] GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 => generated 1288 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:08:05.956848 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-356d4eff-32ce-4528-9ed1-dec2c6dd7395 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:05.957735 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-356d4eff-32ce-4528-9ed1-dec2c6dd7395 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:05.969634 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-356d4eff-32ce-4528-9ed1-dec2c6dd7395 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:05.970331 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-356d4eff-32ce-4528-9ed1-dec2c6dd7395 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:05.971665 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-356d4eff-32ce-4528-9ed1-dec2c6dd7395 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:05.972454 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-356d4eff-32ce-4528-9ed1-dec2c6dd7395 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:06.200738 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-356d4eff-32ce-4528-9ed1-dec2c6dd7395 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:06.208732 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-356d4eff-32ce-4528-9ed1-dec2c6dd7395 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403" status: 200 len: 1318 microversion: 2.1 time: 0.258257 Feb 20 20:08:06.209303 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 274/566] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:05 2022] GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:06.669758 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-b45349ad-d27b-448b-bafc-60b361e7382f req-84df807b-5fd5-47cc-a0d4-bd2df6edf78d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c24fc5e6-53c6-422a-b7f3-66a6cb6d5403", "tag": "d872fe09-a9ab-4392-ac8e-1421bc217d95"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:08:06.672410 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:08:06.672410 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:08:06.684753 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-b45349ad-d27b-448b-bafc-60b361e7382f req-84df807b-5fd5-47cc-a0d4-bd2df6edf78d service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:06.685654 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-b45349ad-d27b-448b-bafc-60b361e7382f req-84df807b-5fd5-47cc-a0d4-bd2df6edf78d service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:06.700762 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-b45349ad-d27b-448b-bafc-60b361e7382f req-84df807b-5fd5-47cc-a0d4-bd2df6edf78d service nova] Creating event network-changed:d872fe09-a9ab-4392-ac8e-1421bc217d95 for instance c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 on hv-cinder-83008 Feb 20 20:08:06.706703 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-b45349ad-d27b-448b-bafc-60b361e7382f req-84df807b-5fd5-47cc-a0d4-bd2df6edf78d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042216 Feb 20 20:08:06.707571 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 293/567] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:08:07.233427 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9178d4db-0c16-4181-80d9-8e20b4bc99cf tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:07.234503 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9178d4db-0c16-4181-80d9-8e20b4bc99cf tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:07.243621 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9178d4db-0c16-4181-80d9-8e20b4bc99cf tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:07.244097 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9178d4db-0c16-4181-80d9-8e20b4bc99cf tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:07.244893 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9178d4db-0c16-4181-80d9-8e20b4bc99cf tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:07.245402 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9178d4db-0c16-4181-80d9-8e20b4bc99cf tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:07.538061 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-9178d4db-0c16-4181-80d9-8e20b4bc99cf tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:07.547558 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9178d4db-0c16-4181-80d9-8e20b4bc99cf tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403" status: 200 len: 1318 microversion: 2.1 time: 0.319946 Feb 20 20:08:07.548291 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 275/568] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:07 2022] GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:08:08.567023 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-113c9e07-6f75-4f22-a2af-ff83e9432fe7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:08.567730 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-113c9e07-6f75-4f22-a2af-ff83e9432fe7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:08.574944 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-113c9e07-6f75-4f22-a2af-ff83e9432fe7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:08.576679 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-113c9e07-6f75-4f22-a2af-ff83e9432fe7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:08.577658 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-113c9e07-6f75-4f22-a2af-ff83e9432fe7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:08.578115 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-113c9e07-6f75-4f22-a2af-ff83e9432fe7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:08.737389 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-113c9e07-6f75-4f22-a2af-ff83e9432fe7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:08.746881 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-113c9e07-6f75-4f22-a2af-ff83e9432fe7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403" status: 200 len: 1318 microversion: 2.1 time: 0.184457 Feb 20 20:08:08.747613 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 294/569] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:08 2022] GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:09.629940 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-70791146-2989-4e83-87a3-1bf4a1faa1d9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1202258204", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-640523116", "security_groups": [{"name": "tempest-secgroup-smoke-1140847490"}], "block_device_mapping_v2": [{"uuid": "c23d5de0-304f-4635-b8e5-c516eec0c693", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3ddb480e-c808-4081-b0cb-679d7704b478"}]}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:08:09.759338 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.network.neutron [None req-70791146-2989-4e83-87a3-1bf4a1faa1d9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] validate_networks() for [('3ddb480e-c808-4081-b0cb-679d7704b478', None, None, None, None, None)] {{(pid=117087) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 20 20:08:09.766094 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f0a73352-26ce-42bc-8b2f-67f7cfe91560 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:09.766899 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f0a73352-26ce-42bc-8b2f-67f7cfe91560 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:09.776193 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f0a73352-26ce-42bc-8b2f-67f7cfe91560 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:09.777478 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f0a73352-26ce-42bc-8b2f-67f7cfe91560 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:09.778325 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f0a73352-26ce-42bc-8b2f-67f7cfe91560 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:09.778902 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f0a73352-26ce-42bc-8b2f-67f7cfe91560 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:10.017028 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f0a73352-26ce-42bc-8b2f-67f7cfe91560 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:10.025029 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f0a73352-26ce-42bc-8b2f-67f7cfe91560 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403" status: 200 len: 1318 microversion: 2.1 time: 0.264753 Feb 20 20:08:10.025676 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 295/570] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:09 2022] GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:08:10.252415 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-70791146-2989-4e83-87a3-1bf4a1faa1d9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Flavor limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 20 20:08:10.252830 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-70791146-2989-4e83-87a3-1bf4a1faa1d9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Image limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 20 20:08:10.253360 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-70791146-2989-4e83-87a3-1bf4a1faa1d9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Flavor pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 20 20:08:10.253759 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-70791146-2989-4e83-87a3-1bf4a1faa1d9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Image pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 20 20:08:10.254156 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-70791146-2989-4e83-87a3-1bf4a1faa1d9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 20 20:08:10.264297 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-70791146-2989-4e83-87a3-1bf4a1faa1d9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:10.264740 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-70791146-2989-4e83-87a3-1bf4a1faa1d9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:10.265645 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-70791146-2989-4e83-87a3-1bf4a1faa1d9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:10.266078 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-70791146-2989-4e83-87a3-1bf4a1faa1d9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:10.283352 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-70791146-2989-4e83-87a3-1bf4a1faa1d9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Getting quotas for project 7d15dcb9692c401e9d0e06361839bb8b. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:08:10.287421 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-70791146-2989-4e83-87a3-1bf4a1faa1d9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Getting quotas for user 62b3136320e64532991e5dd5a199e4d8 and project 7d15dcb9692c401e9d0e06361839bb8b. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:08:10.351740 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-70791146-2989-4e83-87a3-1bf4a1faa1d9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Going to run 1 instances... {{(pid=117087) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 20 20:08:10.351898 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-70791146-2989-4e83-87a3-1bf4a1faa1d9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c23d5de0-304f-4635-b8e5-c516eec0c693',volume_size=None,volume_type=None)] {{(pid=117087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 20 20:08:10.906422 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-70791146-2989-4e83-87a3-1bf4a1faa1d9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.280262 Feb 20 20:08:10.909703 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 276/571] 10.222.0.60 () {60 vars in 1146 bytes} [Sun Feb 20 20:08:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 20 20:08:10.917816 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b5e460a2-b3ec-410c-86d1-e9604963fc56 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:10.918492 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b5e460a2-b3ec-410c-86d1-e9604963fc56 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:10.978451 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b5e460a2-b3ec-410c-86d1-e9604963fc56 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:10.985122 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b5e460a2-b3ec-410c-86d1-e9604963fc56 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 200 len: 1094 microversion: 2.1 time: 0.070955 Feb 20 20:08:10.985720 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 296/572] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:10 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:08:11.044089 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-006cc008-fd38-4f07-9a23-4931f0ef359b tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:11.044276 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-006cc008-fd38-4f07-9a23-4931f0ef359b tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:11.050857 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-006cc008-fd38-4f07-9a23-4931f0ef359b tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:11.051312 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-006cc008-fd38-4f07-9a23-4931f0ef359b tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:11.052097 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-006cc008-fd38-4f07-9a23-4931f0ef359b tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:11.052531 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-006cc008-fd38-4f07-9a23-4931f0ef359b tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:11.249895 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-006cc008-fd38-4f07-9a23-4931f0ef359b tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:11.260413 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-006cc008-fd38-4f07-9a23-4931f0ef359b tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403" status: 200 len: 1318 microversion: 2.1 time: 0.220712 Feb 20 20:08:11.263392 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 277/573] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:11 2022] GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:12.003715 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-802ea51d-0dee-453f-a62d-1564623d5415 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:12.004441 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-802ea51d-0dee-453f-a62d-1564623d5415 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:12.069497 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-802ea51d-0dee-453f-a62d-1564623d5415 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:12.079656 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-802ea51d-0dee-453f-a62d-1564623d5415 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 200 len: 1094 microversion: 2.1 time: 0.080286 Feb 20 20:08:12.080482 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 297/574] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:11 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:12.282888 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2197e9da-9d44-47c2-a80f-3ef2584ce24c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:12.283873 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2197e9da-9d44-47c2-a80f-3ef2584ce24c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:12.291004 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2197e9da-9d44-47c2-a80f-3ef2584ce24c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:12.291445 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2197e9da-9d44-47c2-a80f-3ef2584ce24c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:12.304527 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2197e9da-9d44-47c2-a80f-3ef2584ce24c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:12.304527 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2197e9da-9d44-47c2-a80f-3ef2584ce24c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:12.461554 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2197e9da-9d44-47c2-a80f-3ef2584ce24c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:12.472272 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2197e9da-9d44-47c2-a80f-3ef2584ce24c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403" status: 200 len: 1318 microversion: 2.1 time: 0.194867 Feb 20 20:08:12.473205 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 278/575] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:12 2022] GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:13.098303 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d8425959-310d-4187-8f1a-9ccf4b38ef5e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:13.098829 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d8425959-310d-4187-8f1a-9ccf4b38ef5e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:13.105243 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d8425959-310d-4187-8f1a-9ccf4b38ef5e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:13.105786 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d8425959-310d-4187-8f1a-9ccf4b38ef5e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:13.106556 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d8425959-310d-4187-8f1a-9ccf4b38ef5e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:13.106983 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d8425959-310d-4187-8f1a-9ccf4b38ef5e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:13.442908 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d8425959-310d-4187-8f1a-9ccf4b38ef5e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:13.452047 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d8425959-310d-4187-8f1a-9ccf4b38ef5e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 200 len: 1192 microversion: 2.1 time: 0.357456 Feb 20 20:08:13.452635 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 298/576] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:13 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 1192 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:08:13.489956 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-942f191a-cd9c-4b3c-8a2b-1997a0fb0348 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:13.490915 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-942f191a-cd9c-4b3c-8a2b-1997a0fb0348 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:13.499503 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-942f191a-cd9c-4b3c-8a2b-1997a0fb0348 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:13.502612 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-942f191a-cd9c-4b3c-8a2b-1997a0fb0348 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:13.502612 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-942f191a-cd9c-4b3c-8a2b-1997a0fb0348 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:13.502612 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-942f191a-cd9c-4b3c-8a2b-1997a0fb0348 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:13.651454 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-942f191a-cd9c-4b3c-8a2b-1997a0fb0348 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:13.660389 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-942f191a-cd9c-4b3c-8a2b-1997a0fb0348 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403" status: 200 len: 1318 microversion: 2.1 time: 0.174000 Feb 20 20:08:13.661427 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 279/577] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:13 2022] GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:14.294276 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-1bff3963-6d91-42be-8a9f-bebfb21f4f93 req-903362ec-4316-4eaf-977a-84a0905e7c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c24fc5e6-53c6-422a-b7f3-66a6cb6d5403", "name": "network-vif-plugged", "status": "completed", "tag": "d872fe09-a9ab-4392-ac8e-1421bc217d95"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:08:14.296252 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:08:14.296252 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:08:14.304313 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-1bff3963-6d91-42be-8a9f-bebfb21f4f93 req-903362ec-4316-4eaf-977a-84a0905e7c00 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:14.304791 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-1bff3963-6d91-42be-8a9f-bebfb21f4f93 req-903362ec-4316-4eaf-977a-84a0905e7c00 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:14.317269 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-1bff3963-6d91-42be-8a9f-bebfb21f4f93 req-903362ec-4316-4eaf-977a-84a0905e7c00 service nova] Creating event network-vif-plugged:d872fe09-a9ab-4392-ac8e-1421bc217d95 for instance c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 on hv-cinder-83008 Feb 20 20:08:14.327191 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-1bff3963-6d91-42be-8a9f-bebfb21f4f93 req-903362ec-4316-4eaf-977a-84a0905e7c00 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035908 Feb 20 20:08:14.327191 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 299/578] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:08:14.471820 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3925d6ae-e27c-4458-b967-70d5324f26da tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:14.472442 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3925d6ae-e27c-4458-b967-70d5324f26da tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:14.480550 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3925d6ae-e27c-4458-b967-70d5324f26da tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:14.481222 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3925d6ae-e27c-4458-b967-70d5324f26da tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:14.482136 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3925d6ae-e27c-4458-b967-70d5324f26da tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:14.482705 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3925d6ae-e27c-4458-b967-70d5324f26da tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:14.585335 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3925d6ae-e27c-4458-b967-70d5324f26da tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:14.594224 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3925d6ae-e27c-4458-b967-70d5324f26da tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 200 len: 1210 microversion: 2.1 time: 0.127234 Feb 20 20:08:14.594817 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 280/579] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:14 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 1210 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:08:14.679083 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-25010c87-4700-4d5e-a2ec-467bf65bfe06 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:14.679792 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-25010c87-4700-4d5e-a2ec-467bf65bfe06 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:14.687482 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-25010c87-4700-4d5e-a2ec-467bf65bfe06 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:14.688131 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-25010c87-4700-4d5e-a2ec-467bf65bfe06 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:14.688913 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-25010c87-4700-4d5e-a2ec-467bf65bfe06 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:14.689424 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-25010c87-4700-4d5e-a2ec-467bf65bfe06 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:14.869952 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-25010c87-4700-4d5e-a2ec-467bf65bfe06 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:14.878741 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-25010c87-4700-4d5e-a2ec-467bf65bfe06 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403" status: 200 len: 1318 microversion: 2.1 time: 0.203900 Feb 20 20:08:14.879325 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 300/580] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:14 2022] GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:08:15.611945 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ac363bc7-eb64-4027-8864-f7a96d1d62ab tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:15.612566 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ac363bc7-eb64-4027-8864-f7a96d1d62ab tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:15.619167 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ac363bc7-eb64-4027-8864-f7a96d1d62ab tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:15.619619 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ac363bc7-eb64-4027-8864-f7a96d1d62ab tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:15.620408 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ac363bc7-eb64-4027-8864-f7a96d1d62ab tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:15.620936 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ac363bc7-eb64-4027-8864-f7a96d1d62ab tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:15.823355 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ac363bc7-eb64-4027-8864-f7a96d1d62ab tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:15.847051 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ac363bc7-eb64-4027-8864-f7a96d1d62ab tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 200 len: 1278 microversion: 2.1 time: 0.238282 Feb 20 20:08:15.848476 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 281/581] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:15 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 1278 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:15.898838 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d47532c2-2353-487c-a0e8-dd790f5aa764 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:15.901408 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d47532c2-2353-487c-a0e8-dd790f5aa764 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:15.914097 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d47532c2-2353-487c-a0e8-dd790f5aa764 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:15.914897 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d47532c2-2353-487c-a0e8-dd790f5aa764 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:15.916279 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d47532c2-2353-487c-a0e8-dd790f5aa764 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:15.916719 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d47532c2-2353-487c-a0e8-dd790f5aa764 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:16.193108 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d47532c2-2353-487c-a0e8-dd790f5aa764 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:16.203480 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d47532c2-2353-487c-a0e8-dd790f5aa764 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403" status: 200 len: 1318 microversion: 2.1 time: 0.310073 Feb 20 20:08:16.213539 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 301/582] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:15 2022] GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:16.271149 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-28d27786-b1cc-418c-97bd-328ba4287d2e req-97d12701-5cda-4e10-9405-b04ce96a86a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14017978-5ca1-41e3-9cee-2b9fe9d737d3", "tag": "3a701361-cf5b-4df9-9369-e732da8ed34c"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:08:16.277453 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:08:16.277453 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:08:16.288479 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-28d27786-b1cc-418c-97bd-328ba4287d2e req-97d12701-5cda-4e10-9405-b04ce96a86a5 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:16.289442 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-28d27786-b1cc-418c-97bd-328ba4287d2e req-97d12701-5cda-4e10-9405-b04ce96a86a5 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:16.303177 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-28d27786-b1cc-418c-97bd-328ba4287d2e req-97d12701-5cda-4e10-9405-b04ce96a86a5 service nova] Creating event network-changed:3a701361-cf5b-4df9-9369-e732da8ed34c for instance 14017978-5ca1-41e3-9cee-2b9fe9d737d3 on hv-cinder-83008 Feb 20 20:08:16.310340 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-28d27786-b1cc-418c-97bd-328ba4287d2e req-97d12701-5cda-4e10-9405-b04ce96a86a5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043742 Feb 20 20:08:16.310946 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 282/583] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:08:16.863952 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-28b082bf-527a-446d-8c40-af6269a3888b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:16.864618 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-28b082bf-527a-446d-8c40-af6269a3888b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:16.871577 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-28b082bf-527a-446d-8c40-af6269a3888b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:16.872067 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-28b082bf-527a-446d-8c40-af6269a3888b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:16.872849 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-28b082bf-527a-446d-8c40-af6269a3888b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:16.873317 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-28b082bf-527a-446d-8c40-af6269a3888b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:17.078050 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-28b082bf-527a-446d-8c40-af6269a3888b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:17.086974 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-28b082bf-527a-446d-8c40-af6269a3888b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 200 len: 1266 microversion: 2.1 time: 0.226722 Feb 20 20:08:17.087589 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 302/584] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:16 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:08:17.223478 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5ba79c7b-304c-46cb-a391-e35eaa7ecf0f tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:17.224343 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5ba79c7b-304c-46cb-a391-e35eaa7ecf0f tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:17.232313 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5ba79c7b-304c-46cb-a391-e35eaa7ecf0f tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:17.232913 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5ba79c7b-304c-46cb-a391-e35eaa7ecf0f tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:17.234012 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5ba79c7b-304c-46cb-a391-e35eaa7ecf0f tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:17.234482 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5ba79c7b-304c-46cb-a391-e35eaa7ecf0f tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:17.412987 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5ba79c7b-304c-46cb-a391-e35eaa7ecf0f tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:17.424355 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5ba79c7b-304c-46cb-a391-e35eaa7ecf0f tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403" status: 200 len: 1508 microversion: 2.1 time: 0.206764 Feb 20 20:08:17.425115 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 283/585] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:17 2022] GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 => generated 1508 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:18.106215 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2ab1864c-4263-4000-a923-e19f1848b4af tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:18.106948 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2ab1864c-4263-4000-a923-e19f1848b4af tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:18.119057 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2ab1864c-4263-4000-a923-e19f1848b4af tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:18.119057 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2ab1864c-4263-4000-a923-e19f1848b4af tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:18.119057 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2ab1864c-4263-4000-a923-e19f1848b4af tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:18.119057 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2ab1864c-4263-4000-a923-e19f1848b4af tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:18.292911 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2ab1864c-4263-4000-a923-e19f1848b4af tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:18.305670 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2ab1864c-4263-4000-a923-e19f1848b4af tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 200 len: 1266 microversion: 2.1 time: 0.202868 Feb 20 20:08:18.306831 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 303/586] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:18 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:19.332073 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a4f5864b-0e78-4c96-b222-c12257cf25c4 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:19.332855 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a4f5864b-0e78-4c96-b222-c12257cf25c4 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:19.338807 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a4f5864b-0e78-4c96-b222-c12257cf25c4 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:19.339779 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a4f5864b-0e78-4c96-b222-c12257cf25c4 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:19.340751 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a4f5864b-0e78-4c96-b222-c12257cf25c4 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:19.341069 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a4f5864b-0e78-4c96-b222-c12257cf25c4 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:19.387854 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-cc61b614-f44d-41aa-ba1a-a6ec5543a756 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6919ad44-c301-4a2b-8569-9b567386d0ad"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:08:19.389808 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-cc61b614-f44d-41aa-ba1a-a6ec5543a756 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:19.399874 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cc61b614-f44d-41aa-ba1a-a6ec5543a756 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:19.400325 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cc61b614-f44d-41aa-ba1a-a6ec5543a756 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:19.422817 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cc61b614-f44d-41aa-ba1a-a6ec5543a756 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:19.422817 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cc61b614-f44d-41aa-ba1a-a6ec5543a756 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:19.534977 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a4f5864b-0e78-4c96-b222-c12257cf25c4 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:19.543740 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a4f5864b-0e78-4c96-b222-c12257cf25c4 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 200 len: 1266 microversion: 2.1 time: 0.216270 Feb 20 20:08:19.544336 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 284/587] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:19 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:20.561036 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c9ce88de-0ed0-41f2-8462-8e9a231c06dc tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:20.561788 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c9ce88de-0ed0-41f2-8462-8e9a231c06dc tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:20.569211 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c9ce88de-0ed0-41f2-8462-8e9a231c06dc tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:20.569657 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c9ce88de-0ed0-41f2-8462-8e9a231c06dc tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:20.570435 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c9ce88de-0ed0-41f2-8462-8e9a231c06dc tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:20.570866 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c9ce88de-0ed0-41f2-8462-8e9a231c06dc tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:20.720765 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-cc61b614-f44d-41aa-ba1a-a6ec5543a756 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "POST /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.339190 Feb 20 20:08:20.732023 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 304/588] 10.222.0.60 () {60 vars in 1322 bytes} [Sun Feb 20 20:08:19 2022] POST /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403/os-volume_attachments => generated 194 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:08:20.732459 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c9ce88de-0ed0-41f2-8462-8e9a231c06dc tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:20.742929 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c9ce88de-0ed0-41f2-8462-8e9a231c06dc tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 200 len: 1266 microversion: 2.1 time: 0.185902 Feb 20 20:08:20.744126 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 285/589] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:20 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:08:21.768843 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b3f485fb-4bea-4bdf-b6fe-b83f54a1aea0 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:21.769630 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b3f485fb-4bea-4bdf-b6fe-b83f54a1aea0 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:21.776033 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b3f485fb-4bea-4bdf-b6fe-b83f54a1aea0 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:21.776650 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b3f485fb-4bea-4bdf-b6fe-b83f54a1aea0 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:21.777530 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b3f485fb-4bea-4bdf-b6fe-b83f54a1aea0 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:21.777970 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b3f485fb-4bea-4bdf-b6fe-b83f54a1aea0 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:21.947880 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4f9d7e5c-250a-40c4-9358-473d48421a6b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:21.949677 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4f9d7e5c-250a-40c4-9358-473d48421a6b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:21.956579 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4f9d7e5c-250a-40c4-9358-473d48421a6b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:21.957121 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4f9d7e5c-250a-40c4-9358-473d48421a6b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:21.958050 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4f9d7e5c-250a-40c4-9358-473d48421a6b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:21.958564 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4f9d7e5c-250a-40c4-9358-473d48421a6b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:21.962572 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b3f485fb-4bea-4bdf-b6fe-b83f54a1aea0 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:21.972069 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b3f485fb-4bea-4bdf-b6fe-b83f54a1aea0 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 200 len: 1266 microversion: 2.1 time: 0.207483 Feb 20 20:08:21.973239 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 305/590] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:21 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:21.998817 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4f9d7e5c-250a-40c4-9358-473d48421a6b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-volume_attachments/61b58779-e073-42db-ad32-5641e521d41d" status: 200 len: 194 microversion: 2.20 time: 0.055301 Feb 20 20:08:21.999421 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 286/591] 10.222.0.60 () {60 vars in 1453 bytes} [Sun Feb 20 20:08:21 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-volume_attachments/61b58779-e073-42db-ad32-5641e521d41d => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 20 20:08:22.070474 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-20862a7d-a78a-4fac-b748-cd250ce1a5ca tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:22.070979 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-20862a7d-a78a-4fac-b748-cd250ce1a5ca tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:22.078448 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-20862a7d-a78a-4fac-b748-cd250ce1a5ca tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:22.084605 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-20862a7d-a78a-4fac-b748-cd250ce1a5ca tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:22.084605 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-20862a7d-a78a-4fac-b748-cd250ce1a5ca tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:22.084605 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-20862a7d-a78a-4fac-b748-cd250ce1a5ca tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:22.169636 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-20862a7d-a78a-4fac-b748-cd250ce1a5ca tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lazy-loading 'services' on Instance uuid d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:08:22.509001 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-20862a7d-a78a-4fac-b748-cd250ce1a5ca tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-volume_attachments/61b58779-e073-42db-ad32-5641e521d41d" status: 202 len: 0 microversion: 2.20 time: 0.441916 Feb 20 20:08:22.509711 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 306/592] 10.222.0.60 () {60 vars in 1456 bytes} [Sun Feb 20 20:08:22 2022] DELETE /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-volume_attachments/61b58779-e073-42db-ad32-5641e521d41d => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 20 20:08:22.524863 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3f344c2e-d95f-4615-a653-a8919599ac05 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:22.527229 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3f344c2e-d95f-4615-a653-a8919599ac05 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:22.533919 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3f344c2e-d95f-4615-a653-a8919599ac05 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:22.537172 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3f344c2e-d95f-4615-a653-a8919599ac05 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:22.537172 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3f344c2e-d95f-4615-a653-a8919599ac05 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:22.537172 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3f344c2e-d95f-4615-a653-a8919599ac05 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:22.575428 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3f344c2e-d95f-4615-a653-a8919599ac05 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059045 Feb 20 20:08:22.576015 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 287/593] 10.222.0.60 () {60 vars in 1342 bytes} [Sun Feb 20 20:08:22 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 20 20:08:22.991583 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d1247872-cfa3-40b0-bf19-9758a8655082 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:22.992429 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d1247872-cfa3-40b0-bf19-9758a8655082 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:22.999438 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d1247872-cfa3-40b0-bf19-9758a8655082 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:22.999874 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d1247872-cfa3-40b0-bf19-9758a8655082 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:23.000657 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d1247872-cfa3-40b0-bf19-9758a8655082 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:23.001106 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d1247872-cfa3-40b0-bf19-9758a8655082 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:23.185672 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d1247872-cfa3-40b0-bf19-9758a8655082 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:23.193401 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d1247872-cfa3-40b0-bf19-9758a8655082 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 200 len: 1266 microversion: 2.1 time: 0.206386 Feb 20 20:08:23.193978 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 307/594] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:22 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:23.591324 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-42e15475-5d4a-4f11-9af8-aba3c7e5abfd tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:23.592213 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-42e15475-5d4a-4f11-9af8-aba3c7e5abfd tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:23.599837 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-42e15475-5d4a-4f11-9af8-aba3c7e5abfd tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:23.600259 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-42e15475-5d4a-4f11-9af8-aba3c7e5abfd tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:23.601072 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-42e15475-5d4a-4f11-9af8-aba3c7e5abfd tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:23.601540 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-42e15475-5d4a-4f11-9af8-aba3c7e5abfd tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:23.634202 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-42e15475-5d4a-4f11-9af8-aba3c7e5abfd tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047467 Feb 20 20:08:23.634792 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 288/595] 10.222.0.60 () {60 vars in 1342 bytes} [Sun Feb 20 20:08:23 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 20 20:08:24.212467 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e84674cf-cda9-4968-a845-06fb1c5ab0fd tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:24.213367 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e84674cf-cda9-4968-a845-06fb1c5ab0fd tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:24.221642 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e84674cf-cda9-4968-a845-06fb1c5ab0fd tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:24.222488 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e84674cf-cda9-4968-a845-06fb1c5ab0fd tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:24.223434 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e84674cf-cda9-4968-a845-06fb1c5ab0fd tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:24.224086 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e84674cf-cda9-4968-a845-06fb1c5ab0fd tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:24.392589 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e84674cf-cda9-4968-a845-06fb1c5ab0fd tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:24.406082 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e84674cf-cda9-4968-a845-06fb1c5ab0fd tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 200 len: 1266 microversion: 2.1 time: 0.198314 Feb 20 20:08:24.407109 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 308/596] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:24 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:24.649443 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-871b5d19-0adb-4850-aaef-e1134d5440d0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:24.650874 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-871b5d19-0adb-4850-aaef-e1134d5440d0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:24.658783 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-871b5d19-0adb-4850-aaef-e1134d5440d0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:24.659220 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-871b5d19-0adb-4850-aaef-e1134d5440d0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:24.660024 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-871b5d19-0adb-4850-aaef-e1134d5440d0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:24.660455 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-871b5d19-0adb-4850-aaef-e1134d5440d0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:24.705931 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-871b5d19-0adb-4850-aaef-e1134d5440d0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061641 Feb 20 20:08:24.706790 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 289/597] 10.222.0.60 () {60 vars in 1342 bytes} [Sun Feb 20 20:08:24 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 20 20:08:25.425852 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b64dee62-ea1b-4f6e-929f-7f0720c1f778 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:25.426496 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b64dee62-ea1b-4f6e-929f-7f0720c1f778 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:25.433031 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b64dee62-ea1b-4f6e-929f-7f0720c1f778 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:25.433506 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b64dee62-ea1b-4f6e-929f-7f0720c1f778 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:25.434290 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b64dee62-ea1b-4f6e-929f-7f0720c1f778 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:25.434723 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b64dee62-ea1b-4f6e-929f-7f0720c1f778 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:25.598998 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b64dee62-ea1b-4f6e-929f-7f0720c1f778 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:25.607454 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b64dee62-ea1b-4f6e-929f-7f0720c1f778 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 200 len: 1266 microversion: 2.1 time: 0.186259 Feb 20 20:08:25.608042 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 309/598] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:25 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:08:25.722933 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-38385c49-8165-4554-86c6-4663efa687a8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:25.724225 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-38385c49-8165-4554-86c6-4663efa687a8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:25.733961 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-38385c49-8165-4554-86c6-4663efa687a8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:25.734398 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-38385c49-8165-4554-86c6-4663efa687a8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:25.735186 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-38385c49-8165-4554-86c6-4663efa687a8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:25.735615 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-38385c49-8165-4554-86c6-4663efa687a8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:25.778635 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-38385c49-8165-4554-86c6-4663efa687a8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062312 Feb 20 20:08:25.779249 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 290/599] 10.222.0.60 () {60 vars in 1342 bytes} [Sun Feb 20 20:08:25 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 20 20:08:26.625476 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4f2aa8cc-b38c-467d-8f69-b83f35d81331 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:26.626111 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4f2aa8cc-b38c-467d-8f69-b83f35d81331 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:26.633026 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4f2aa8cc-b38c-467d-8f69-b83f35d81331 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:26.633504 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4f2aa8cc-b38c-467d-8f69-b83f35d81331 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:26.634289 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4f2aa8cc-b38c-467d-8f69-b83f35d81331 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:26.634726 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4f2aa8cc-b38c-467d-8f69-b83f35d81331 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:26.785798 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4f2aa8cc-b38c-467d-8f69-b83f35d81331 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:26.791279 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-637e4bb0-1bd2-4c15-9d7b-a81fce77c8ba tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:26.792304 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-637e4bb0-1bd2-4c15-9d7b-a81fce77c8ba tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:26.800755 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-637e4bb0-1bd2-4c15-9d7b-a81fce77c8ba tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:26.801254 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-637e4bb0-1bd2-4c15-9d7b-a81fce77c8ba tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:26.802048 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-637e4bb0-1bd2-4c15-9d7b-a81fce77c8ba tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:26.802572 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-637e4bb0-1bd2-4c15-9d7b-a81fce77c8ba tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:26.803267 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4f2aa8cc-b38c-467d-8f69-b83f35d81331 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 200 len: 1266 microversion: 2.1 time: 0.181810 Feb 20 20:08:26.804011 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 310/600] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:26 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:26.845621 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-637e4bb0-1bd2-4c15-9d7b-a81fce77c8ba tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057865 Feb 20 20:08:26.846374 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 291/601] 10.222.0.60 () {60 vars in 1342 bytes} [Sun Feb 20 20:08:26 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 20 20:08:27.820794 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-76c3a761-dedd-471d-974c-fd034b15cf0f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:27.821519 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-76c3a761-dedd-471d-974c-fd034b15cf0f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:27.828582 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-76c3a761-dedd-471d-974c-fd034b15cf0f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:27.828958 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-76c3a761-dedd-471d-974c-fd034b15cf0f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:27.829871 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-76c3a761-dedd-471d-974c-fd034b15cf0f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:27.830312 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-76c3a761-dedd-471d-974c-fd034b15cf0f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:27.858002 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6aa24110-c623-476c-801f-19b9312353ae tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:27.859189 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6aa24110-c623-476c-801f-19b9312353ae tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:27.866581 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6aa24110-c623-476c-801f-19b9312353ae tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:27.867121 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6aa24110-c623-476c-801f-19b9312353ae tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:27.868030 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6aa24110-c623-476c-801f-19b9312353ae tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:27.868560 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6aa24110-c623-476c-801f-19b9312353ae tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:27.912320 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6aa24110-c623-476c-801f-19b9312353ae tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058284 Feb 20 20:08:27.912906 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 292/602] 10.222.0.60 () {60 vars in 1342 bytes} [Sun Feb 20 20:08:27 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 20 20:08:28.024484 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-76c3a761-dedd-471d-974c-fd034b15cf0f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:28.033511 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-76c3a761-dedd-471d-974c-fd034b15cf0f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 200 len: 1266 microversion: 2.1 time: 0.216871 Feb 20 20:08:28.034163 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 311/603] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:27 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:28.271918 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-6f6ce476-2ad7-4405-8199-06d2f4eae42a req-b4c3e68d-9b23-4f91-af3d-9d610f2113b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14017978-5ca1-41e3-9cee-2b9fe9d737d3", "name": "network-vif-plugged", "status": "completed", "tag": "3a701361-cf5b-4df9-9369-e732da8ed34c"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:08:28.273603 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:08:28.273603 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:08:28.284089 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-6f6ce476-2ad7-4405-8199-06d2f4eae42a req-b4c3e68d-9b23-4f91-af3d-9d610f2113b5 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:28.284707 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-6f6ce476-2ad7-4405-8199-06d2f4eae42a req-b4c3e68d-9b23-4f91-af3d-9d610f2113b5 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:28.299181 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-6f6ce476-2ad7-4405-8199-06d2f4eae42a req-b4c3e68d-9b23-4f91-af3d-9d610f2113b5 service nova] Creating event network-vif-plugged:3a701361-cf5b-4df9-9369-e732da8ed34c for instance 14017978-5ca1-41e3-9cee-2b9fe9d737d3 on hv-cinder-83008 Feb 20 20:08:28.308310 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-6f6ce476-2ad7-4405-8199-06d2f4eae42a req-b4c3e68d-9b23-4f91-af3d-9d610f2113b5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038959 Feb 20 20:08:28.309437 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 293/604] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:08:28.924654 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-609083d5-5817-40b4-aaf7-8eae5b52bf03 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:28.925638 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-609083d5-5817-40b4-aaf7-8eae5b52bf03 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:28.932214 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-609083d5-5817-40b4-aaf7-8eae5b52bf03 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:28.933394 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-609083d5-5817-40b4-aaf7-8eae5b52bf03 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:28.939187 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-609083d5-5817-40b4-aaf7-8eae5b52bf03 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:28.939187 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-609083d5-5817-40b4-aaf7-8eae5b52bf03 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:28.965840 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-609083d5-5817-40b4-aaf7-8eae5b52bf03 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045015 Feb 20 20:08:28.966672 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 312/605] 10.222.0.60 () {60 vars in 1342 bytes} [Sun Feb 20 20:08:28 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 20 20:08:29.055374 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3a1680f2-b14c-4576-84b0-5e4c8be27971 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:29.056218 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3a1680f2-b14c-4576-84b0-5e4c8be27971 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:29.063564 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3a1680f2-b14c-4576-84b0-5e4c8be27971 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:29.064021 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3a1680f2-b14c-4576-84b0-5e4c8be27971 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:29.064813 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3a1680f2-b14c-4576-84b0-5e4c8be27971 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:29.065282 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3a1680f2-b14c-4576-84b0-5e4c8be27971 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:29.224491 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3a1680f2-b14c-4576-84b0-5e4c8be27971 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:29.229269 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3a1680f2-b14c-4576-84b0-5e4c8be27971 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 200 len: 1266 microversion: 2.1 time: 0.178610 Feb 20 20:08:29.231108 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 294/606] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:29 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:29.406468 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d20a47ca-d727-4aac-86ef-6d7bafd68472 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-150091772", "imageRef": "61c0cc70-53e3-40ed-b353-ec1b5fc4eea4", "flavorRef": "452", "networks": [{"uuid": "8b2a19f4-c94f-444f-9511-f39cc6853442"}]}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:08:29.465276 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.network.neutron [None req-d20a47ca-d727-4aac-86ef-6d7bafd68472 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] validate_networks() for [('8b2a19f4-c94f-444f-9511-f39cc6853442', None, None, None, None, None)] {{(pid=117088) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 20 20:08:29.913560 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-d20a47ca-d727-4aac-86ef-6d7bafd68472 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Flavor limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 20 20:08:29.914021 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-d20a47ca-d727-4aac-86ef-6d7bafd68472 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Image limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 20 20:08:29.914496 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-d20a47ca-d727-4aac-86ef-6d7bafd68472 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Flavor pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 20 20:08:29.914914 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-d20a47ca-d727-4aac-86ef-6d7bafd68472 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Image pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 20 20:08:29.915324 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-d20a47ca-d727-4aac-86ef-6d7bafd68472 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 20 20:08:29.926216 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d20a47ca-d727-4aac-86ef-6d7bafd68472 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:29.927333 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d20a47ca-d727-4aac-86ef-6d7bafd68472 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:29.928128 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d20a47ca-d727-4aac-86ef-6d7bafd68472 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:29.928677 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d20a47ca-d727-4aac-86ef-6d7bafd68472 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:29.948117 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-d20a47ca-d727-4aac-86ef-6d7bafd68472 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Getting quotas for project 79884d2db8f34ea3a56bb24700c0834b. Resources: {'instances', 'cores', 'ram'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:08:29.952602 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-d20a47ca-d727-4aac-86ef-6d7bafd68472 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Getting quotas for user 3c74b25bf2e94447ab74a7e157eadac7 and project 79884d2db8f34ea3a56bb24700c0834b. Resources: {'instances', 'cores', 'ram'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:08:29.966434 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d20a47ca-d727-4aac-86ef-6d7bafd68472 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Going to run 1 instances... {{(pid=117088) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 20 20:08:29.969121 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d20a47ca-d727-4aac-86ef-6d7bafd68472 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: bdff4760-c8ef-4f40-a118-40c44d576689] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61c0cc70-53e3-40ed-b353-ec1b5fc4eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 20 20:08:29.980278 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9ba6ce52-e68b-4623-a8a4-53229e63fd34 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:29.981259 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9ba6ce52-e68b-4623-a8a4-53229e63fd34 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:29.987631 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9ba6ce52-e68b-4623-a8a4-53229e63fd34 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:29.987997 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9ba6ce52-e68b-4623-a8a4-53229e63fd34 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:29.988702 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9ba6ce52-e68b-4623-a8a4-53229e63fd34 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:29.989182 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9ba6ce52-e68b-4623-a8a4-53229e63fd34 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:30.044639 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9ba6ce52-e68b-4623-a8a4-53229e63fd34 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069624 Feb 20 20:08:30.045512 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 295/607] 10.222.0.60 () {60 vars in 1342 bytes} [Sun Feb 20 20:08:29 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 20 20:08:30.141449 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d20a47ca-d727-4aac-86ef-6d7bafd68472 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738681 Feb 20 20:08:30.142141 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 313/608] 10.222.0.60 () {60 vars in 1146 bytes} [Sun Feb 20 20:08:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 20 20:08:30.155970 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6b213edd-0b2e-43c3-a813-a149ed17fbd8 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:30.156689 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6b213edd-0b2e-43c3-a813-a149ed17fbd8 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: bdff4760-c8ef-4f40-a118-40c44d576689] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:30.224388 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6b213edd-0b2e-43c3-a813-a149ed17fbd8 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:30.239627 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6b213edd-0b2e-43c3-a813-a149ed17fbd8 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689" status: 200 len: 1217 microversion: 2.1 time: 0.088403 Feb 20 20:08:30.242220 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 296/609] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:30 2022] GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689 => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:08:30.249401 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5dcea4c5-0ba1-4195-a005-ff1fcb58e3d8 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:30.250668 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5dcea4c5-0ba1-4195-a005-ff1fcb58e3d8 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:30.260191 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5dcea4c5-0ba1-4195-a005-ff1fcb58e3d8 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:30.261806 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5dcea4c5-0ba1-4195-a005-ff1fcb58e3d8 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:30.263050 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5dcea4c5-0ba1-4195-a005-ff1fcb58e3d8 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:30.263764 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5dcea4c5-0ba1-4195-a005-ff1fcb58e3d8 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:30.500410 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5dcea4c5-0ba1-4195-a005-ff1fcb58e3d8 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:30.508950 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5dcea4c5-0ba1-4195-a005-ff1fcb58e3d8 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 200 len: 1266 microversion: 2.1 time: 0.266066 Feb 20 20:08:30.511453 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 314/610] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:30 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:31.056716 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a6861a88-26f4-48e1-9771-cdac5471b0aa tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:31.057704 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a6861a88-26f4-48e1-9771-cdac5471b0aa tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:31.064697 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a6861a88-26f4-48e1-9771-cdac5471b0aa tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:31.065179 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a6861a88-26f4-48e1-9771-cdac5471b0aa tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:31.065980 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a6861a88-26f4-48e1-9771-cdac5471b0aa tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:31.066420 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a6861a88-26f4-48e1-9771-cdac5471b0aa tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:31.102390 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a6861a88-26f4-48e1-9771-cdac5471b0aa tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049535 Feb 20 20:08:31.103083 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 297/611] 10.222.0.60 () {60 vars in 1342 bytes} [Sun Feb 20 20:08:31 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:08:31.165501 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f70b2728-8ed5-4d0b-bcb6-997ddc71a2bf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:31.166357 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f70b2728-8ed5-4d0b-bcb6-997ddc71a2bf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:31.173840 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f70b2728-8ed5-4d0b-bcb6-997ddc71a2bf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:31.174288 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f70b2728-8ed5-4d0b-bcb6-997ddc71a2bf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:31.175120 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f70b2728-8ed5-4d0b-bcb6-997ddc71a2bf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:31.175553 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f70b2728-8ed5-4d0b-bcb6-997ddc71a2bf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:31.209618 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f70b2728-8ed5-4d0b-bcb6-997ddc71a2bf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 20 20:08:31.263968 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-086883c2-6d67-4543-82f8-08d33e09c0f2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:31.264880 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-086883c2-6d67-4543-82f8-08d33e09c0f2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: bdff4760-c8ef-4f40-a118-40c44d576689] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:31.279870 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-086883c2-6d67-4543-82f8-08d33e09c0f2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:31.280506 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-086883c2-6d67-4543-82f8-08d33e09c0f2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:31.281497 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-086883c2-6d67-4543-82f8-08d33e09c0f2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:31.281940 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-086883c2-6d67-4543-82f8-08d33e09c0f2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:31.358863 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-086883c2-6d67-4543-82f8-08d33e09c0f2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:31.367280 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-086883c2-6d67-4543-82f8-08d33e09c0f2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689" status: 200 len: 1221 microversion: 2.1 time: 0.109651 Feb 20 20:08:31.367893 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 298/612] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:31 2022] GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689 => generated 1221 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:08:31.503460 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f70b2728-8ed5-4d0b-bcb6-997ddc71a2bf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 204 len: 0 microversion: 2.20 time: 0.341634 Feb 20 20:08:31.504062 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 315/613] 10.222.0.60 () {60 vars in 1279 bytes} [Sun Feb 20 20:08:31 2022] DELETE /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 20 20:08:31.514231 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-37d88636-8cf6-4d47-aa2d-bcbd5822eba7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:31.514901 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-37d88636-8cf6-4d47-aa2d-bcbd5822eba7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:31.521839 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-37d88636-8cf6-4d47-aa2d-bcbd5822eba7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:31.522281 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-37d88636-8cf6-4d47-aa2d-bcbd5822eba7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:31.523031 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-37d88636-8cf6-4d47-aa2d-bcbd5822eba7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:31.523463 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-37d88636-8cf6-4d47-aa2d-bcbd5822eba7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:31.528315 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-21dc2f46-c899-4093-a33e-67938f04f32a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:31.529533 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-21dc2f46-c899-4093-a33e-67938f04f32a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:31.535981 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-21dc2f46-c899-4093-a33e-67938f04f32a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:31.536579 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-21dc2f46-c899-4093-a33e-67938f04f32a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:31.537556 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-21dc2f46-c899-4093-a33e-67938f04f32a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:31.538193 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-21dc2f46-c899-4093-a33e-67938f04f32a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:31.769013 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-37d88636-8cf6-4d47-aa2d-bcbd5822eba7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:31.778847 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-37d88636-8cf6-4d47-aa2d-bcbd5822eba7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:31.780442 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-37d88636-8cf6-4d47-aa2d-bcbd5822eba7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:31.781871 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-37d88636-8cf6-4d47-aa2d-bcbd5822eba7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.272458 Feb 20 20:08:31.782569 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 299/614] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:08:31 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:08:31.792128 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-21dc2f46-c899-4093-a33e-67938f04f32a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:31.799762 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-21dc2f46-c899-4093-a33e-67938f04f32a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 200 len: 1452 microversion: 2.1 time: 0.275376 Feb 20 20:08:31.799762 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 316/615] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:31 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 1452 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:31.815664 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c59d950b-e7fa-4793-8989-96439019cb8b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:31.816207 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c59d950b-e7fa-4793-8989-96439019cb8b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:31.822441 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c59d950b-e7fa-4793-8989-96439019cb8b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:31.823496 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c59d950b-e7fa-4793-8989-96439019cb8b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:31.824279 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c59d950b-e7fa-4793-8989-96439019cb8b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:31.824707 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c59d950b-e7fa-4793-8989-96439019cb8b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:31.978979 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c59d950b-e7fa-4793-8989-96439019cb8b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:31.987377 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c59d950b-e7fa-4793-8989-96439019cb8b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 200 len: 1452 microversion: 2.1 time: 0.175282 Feb 20 20:08:31.987971 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 300/616] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:31 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 1452 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:32.386625 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7fe75fbe-edc0-449f-8e2c-1ac51741de0e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:32.388066 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7fe75fbe-edc0-449f-8e2c-1ac51741de0e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: bdff4760-c8ef-4f40-a118-40c44d576689] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:32.404303 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7fe75fbe-edc0-449f-8e2c-1ac51741de0e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:32.404756 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7fe75fbe-edc0-449f-8e2c-1ac51741de0e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:32.406487 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7fe75fbe-edc0-449f-8e2c-1ac51741de0e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:32.407201 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7fe75fbe-edc0-449f-8e2c-1ac51741de0e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:32.507455 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7fe75fbe-edc0-449f-8e2c-1ac51741de0e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:32.517654 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7fe75fbe-edc0-449f-8e2c-1ac51741de0e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689" status: 200 len: 1277 microversion: 2.1 time: 0.135848 Feb 20 20:08:32.518394 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 317/617] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:32 2022] GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689 => generated 1277 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:32.802877 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2ff65036-1916-45cf-8f3c-f512966d43b2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:32.803568 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2ff65036-1916-45cf-8f3c-f512966d43b2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:32.816135 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ff65036-1916-45cf-8f3c-f512966d43b2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:32.816735 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ff65036-1916-45cf-8f3c-f512966d43b2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:32.817807 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ff65036-1916-45cf-8f3c-f512966d43b2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:32.818343 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ff65036-1916-45cf-8f3c-f512966d43b2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:33.073033 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2ff65036-1916-45cf-8f3c-f512966d43b2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:33.082459 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2ff65036-1916-45cf-8f3c-f512966d43b2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:33.084335 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2ff65036-1916-45cf-8f3c-f512966d43b2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:33.086178 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2ff65036-1916-45cf-8f3c-f512966d43b2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.288738 Feb 20 20:08:33.086835 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 301/618] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:08:32 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:08:33.546352 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e7acd162-902e-451d-b678-034156a2e6f5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:33.547665 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e7acd162-902e-451d-b678-034156a2e6f5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: bdff4760-c8ef-4f40-a118-40c44d576689] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:33.555338 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e7acd162-902e-451d-b678-034156a2e6f5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:33.555818 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e7acd162-902e-451d-b678-034156a2e6f5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:33.556681 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e7acd162-902e-451d-b678-034156a2e6f5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:33.557173 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e7acd162-902e-451d-b678-034156a2e6f5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:33.902459 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e7acd162-902e-451d-b678-034156a2e6f5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:33.910587 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e7acd162-902e-451d-b678-034156a2e6f5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689" status: 200 len: 1317 microversion: 2.1 time: 0.369233 Feb 20 20:08:33.911110 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 318/619] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:33 2022] GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689 => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:34.104852 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f7608c01-4747-46dd-8f0f-32b9300ebd7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:34.106257 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f7608c01-4747-46dd-8f0f-32b9300ebd7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:34.114914 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f7608c01-4747-46dd-8f0f-32b9300ebd7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:34.115594 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f7608c01-4747-46dd-8f0f-32b9300ebd7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:34.116533 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f7608c01-4747-46dd-8f0f-32b9300ebd7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:34.116978 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f7608c01-4747-46dd-8f0f-32b9300ebd7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:34.602717 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-d32f36cd-a04d-49a1-aca9-c9d671917b8c req-97622125-9c2d-4fb4-b6b3-e1ae891d7743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14017978-5ca1-41e3-9cee-2b9fe9d737d3", "tag": "3a701361-cf5b-4df9-9369-e732da8ed34c"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:08:34.605160 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:08:34.605160 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:08:34.616068 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-d32f36cd-a04d-49a1-aca9-c9d671917b8c req-97622125-9c2d-4fb4-b6b3-e1ae891d7743 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:34.616519 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-d32f36cd-a04d-49a1-aca9-c9d671917b8c req-97622125-9c2d-4fb4-b6b3-e1ae891d7743 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:34.629061 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-d32f36cd-a04d-49a1-aca9-c9d671917b8c req-97622125-9c2d-4fb4-b6b3-e1ae891d7743 service nova] Creating event network-changed:3a701361-cf5b-4df9-9369-e732da8ed34c for instance 14017978-5ca1-41e3-9cee-2b9fe9d737d3 on hv-cinder-83008 Feb 20 20:08:34.634270 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-d32f36cd-a04d-49a1-aca9-c9d671917b8c req-97622125-9c2d-4fb4-b6b3-e1ae891d7743 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035607 Feb 20 20:08:34.639631 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 319/620] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:08:34.852573 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f7608c01-4747-46dd-8f0f-32b9300ebd7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:34.862711 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f7608c01-4747-46dd-8f0f-32b9300ebd7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:34.864924 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f7608c01-4747-46dd-8f0f-32b9300ebd7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:34.866355 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f7608c01-4747-46dd-8f0f-32b9300ebd7e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1726 microversion: 2.20 time: 0.765792 Feb 20 20:08:34.867471 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 302/621] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:08:34 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1726 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:08:34.932805 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a1b7cc07-424b-4636-b338-b8b1f85d7c8e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:34.934845 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a1b7cc07-424b-4636-b338-b8b1f85d7c8e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: bdff4760-c8ef-4f40-a118-40c44d576689] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:34.950244 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a1b7cc07-424b-4636-b338-b8b1f85d7c8e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:34.952091 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a1b7cc07-424b-4636-b338-b8b1f85d7c8e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:34.955033 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a1b7cc07-424b-4636-b338-b8b1f85d7c8e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:34.956474 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a1b7cc07-424b-4636-b338-b8b1f85d7c8e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:35.296183 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-b0e9b51f-868f-477b-bf11-33bef685f53f req-68d73746-9810-4efa-a1c9-a6c739e92f80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdff4760-c8ef-4f40-a118-40c44d576689", "tag": "e80e85e5-c807-440e-b552-b5406cb0afa7"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:08:35.301381 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:08:35.301381 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:08:35.324002 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-b0e9b51f-868f-477b-bf11-33bef685f53f req-68d73746-9810-4efa-a1c9-a6c739e92f80 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:35.324949 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-b0e9b51f-868f-477b-bf11-33bef685f53f req-68d73746-9810-4efa-a1c9-a6c739e92f80 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:35.351064 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-b0e9b51f-868f-477b-bf11-33bef685f53f req-68d73746-9810-4efa-a1c9-a6c739e92f80 service nova] Creating event network-changed:e80e85e5-c807-440e-b552-b5406cb0afa7 for instance bdff4760-c8ef-4f40-a118-40c44d576689 on hv-cinder-83008 Feb 20 20:08:35.362995 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-b0e9b51f-868f-477b-bf11-33bef685f53f req-68d73746-9810-4efa-a1c9-a6c739e92f80 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076785 Feb 20 20:08:35.364930 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 303/622] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:08:35.419942 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a1b7cc07-424b-4636-b338-b8b1f85d7c8e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:35.438844 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a1b7cc07-424b-4636-b338-b8b1f85d7c8e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689" status: 200 len: 1317 microversion: 2.1 time: 0.513543 Feb 20 20:08:35.439734 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 320/623] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:34 2022] GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689 => generated 1317 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:35.897537 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4de1367d-35c3-401b-93f0-110deedc6278 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:35.904881 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4de1367d-35c3-401b-93f0-110deedc6278 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:35.924099 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4de1367d-35c3-401b-93f0-110deedc6278 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:35.924837 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4de1367d-35c3-401b-93f0-110deedc6278 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:35.925822 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4de1367d-35c3-401b-93f0-110deedc6278 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:35.926531 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4de1367d-35c3-401b-93f0-110deedc6278 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:36.047140 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4de1367d-35c3-401b-93f0-110deedc6278 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:36.070393 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4de1367d-35c3-401b-93f0-110deedc6278 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:36.072022 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4de1367d-35c3-401b-93f0-110deedc6278 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:36.074225 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4de1367d-35c3-401b-93f0-110deedc6278 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1658 microversion: 2.20 time: 0.191240 Feb 20 20:08:36.084695 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 304/624] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:08:35 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1658 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:08:36.465260 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8141d79f-e8b0-48a4-95e6-051d2631f914 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:36.466932 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8141d79f-e8b0-48a4-95e6-051d2631f914 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: bdff4760-c8ef-4f40-a118-40c44d576689] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:36.488440 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8141d79f-e8b0-48a4-95e6-051d2631f914 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:36.491209 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8141d79f-e8b0-48a4-95e6-051d2631f914 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:36.492222 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8141d79f-e8b0-48a4-95e6-051d2631f914 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:36.495606 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8141d79f-e8b0-48a4-95e6-051d2631f914 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:36.692212 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8141d79f-e8b0-48a4-95e6-051d2631f914 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:36.700368 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8141d79f-e8b0-48a4-95e6-051d2631f914 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689" status: 200 len: 1317 microversion: 2.1 time: 0.240389 Feb 20 20:08:36.701027 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 321/625] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:36 2022] GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:37.115264 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d84927c8-0570-449e-b412-f0c2eafd506f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:37.115873 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d84927c8-0570-449e-b412-f0c2eafd506f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:37.124299 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d84927c8-0570-449e-b412-f0c2eafd506f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:37.124860 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d84927c8-0570-449e-b412-f0c2eafd506f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:37.125588 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d84927c8-0570-449e-b412-f0c2eafd506f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:37.126294 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d84927c8-0570-449e-b412-f0c2eafd506f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:37.163305 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d84927c8-0570-449e-b412-f0c2eafd506f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:37.163857 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d84927c8-0570-449e-b412-f0c2eafd506f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:37.164373 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-d84927c8-0570-449e-b412-f0c2eafd506f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lazy-loading 'fault' on Instance uuid d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:08:37.230486 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d84927c8-0570-449e-b412-f0c2eafd506f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:37.236947 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d84927c8-0570-449e-b412-f0c2eafd506f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:37.238806 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d84927c8-0570-449e-b412-f0c2eafd506f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:37.240185 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d84927c8-0570-449e-b412-f0c2eafd506f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 200 len: 1372 microversion: 2.20 time: 0.129140 Feb 20 20:08:37.241659 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 305/626] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:08:37 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 1372 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:08:37.393974 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-31329f29-9359-4ddb-8247-9e3a512280a8 req-97cfa9c5-2b38-440a-b0c0-09ef84d9dcee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97", "name": "network-vif-deleted", "tag": "87a52ebd-35dd-4b56-8924-9578f176542c"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:08:37.395653 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:08:37.395653 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:08:37.403856 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-31329f29-9359-4ddb-8247-9e3a512280a8 req-97cfa9c5-2b38-440a-b0c0-09ef84d9dcee service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:37.404372 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-31329f29-9359-4ddb-8247-9e3a512280a8 req-97cfa9c5-2b38-440a-b0c0-09ef84d9dcee service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:37.420495 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-31329f29-9359-4ddb-8247-9e3a512280a8 req-97cfa9c5-2b38-440a-b0c0-09ef84d9dcee service nova] Creating event network-vif-deleted:87a52ebd-35dd-4b56-8924-9578f176542c for instance d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 on hv-cinder-83008 Feb 20 20:08:37.427458 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-31329f29-9359-4ddb-8247-9e3a512280a8 req-97cfa9c5-2b38-440a-b0c0-09ef84d9dcee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037502 Feb 20 20:08:37.428488 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 322/627] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:08:37.719888 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-dc7ae941-0882-4116-bdf7-cbf9fe078355 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:37.720537 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-dc7ae941-0882-4116-bdf7-cbf9fe078355 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: bdff4760-c8ef-4f40-a118-40c44d576689] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:37.726852 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dc7ae941-0882-4116-bdf7-cbf9fe078355 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:37.727171 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dc7ae941-0882-4116-bdf7-cbf9fe078355 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:37.727970 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dc7ae941-0882-4116-bdf7-cbf9fe078355 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:37.728413 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dc7ae941-0882-4116-bdf7-cbf9fe078355 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:37.908589 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-dc7ae941-0882-4116-bdf7-cbf9fe078355 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:37.916080 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-dc7ae941-0882-4116-bdf7-cbf9fe078355 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689" status: 200 len: 1317 microversion: 2.1 time: 0.200414 Feb 20 20:08:37.916663 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 306/628] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:37 2022] GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689 => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:38.261254 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-1c723918-d62e-4a92-b20d-304e91df0aa5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:38.261957 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-1c723918-d62e-4a92-b20d-304e91df0aa5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:38.268577 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1c723918-d62e-4a92-b20d-304e91df0aa5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:38.269020 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1c723918-d62e-4a92-b20d-304e91df0aa5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:38.269824 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1c723918-d62e-4a92-b20d-304e91df0aa5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:38.270298 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1c723918-d62e-4a92-b20d-304e91df0aa5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:38.285328 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-1c723918-d62e-4a92-b20d-304e91df0aa5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] HTTP exception thrown: Instance d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 could not be found. Feb 20 20:08:38.285842 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-1c723918-d62e-4a92-b20d-304e91df0aa5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Returning 404 to user: Instance d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:08:38.286670 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-1c723918-d62e-4a92-b20d-304e91df0aa5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 404 len: 111 microversion: 2.20 time: 0.030221 Feb 20 20:08:38.287216 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 323/629] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:08:38 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 20 20:08:38.296064 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-42413d21-79e3-41a0-b50e-f4e60e288a2f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '.version_select at 0x7fdd9165df70>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:38.299821 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: ERROR oslo.messaging._drivers.impl_rabbit [None req-42413d21-79e3-41a0-b50e-f4e60e288a2f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [5112d691-af3f-4809-a0e5-77dd461abdee] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 20 20:08:38.934793 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-529d3a97-a758-436b-af30-91ebc2206e46 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:38.935408 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-529d3a97-a758-436b-af30-91ebc2206e46 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: bdff4760-c8ef-4f40-a118-40c44d576689] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:38.943354 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-529d3a97-a758-436b-af30-91ebc2206e46 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:38.943830 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-529d3a97-a758-436b-af30-91ebc2206e46 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:38.944618 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-529d3a97-a758-436b-af30-91ebc2206e46 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:38.945054 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-529d3a97-a758-436b-af30-91ebc2206e46 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:39.128492 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-529d3a97-a758-436b-af30-91ebc2206e46 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:39.143582 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-529d3a97-a758-436b-af30-91ebc2206e46 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689" status: 200 len: 1317 microversion: 2.1 time: 0.213041 Feb 20 20:08:39.155290 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 324/630] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:38 2022] GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689 => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:08:39.310041 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO oslo.messaging._drivers.impl_rabbit [None req-42413d21-79e3-41a0-b50e-f4e60e288a2f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [5112d691-af3f-4809-a0e5-77dd461abdee] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 49646. Feb 20 20:08:39.529275 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-42413d21-79e3-41a0-b50e-f4e60e288a2f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2074067286" status: 204 len: 0 microversion: 2.20 time: 1.237228 Feb 20 20:08:39.529912 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 307/631] 10.222.0.60 () {60 vars in 1261 bytes} [Sun Feb 20 20:08:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2074067286 => generated 0 bytes in 1239 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 20 20:08:40.162728 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-60a087b9-1265-4421-80ec-f0bb8b8b9e90 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:40.163301 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-60a087b9-1265-4421-80ec-f0bb8b8b9e90 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: bdff4760-c8ef-4f40-a118-40c44d576689] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:40.180445 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-60a087b9-1265-4421-80ec-f0bb8b8b9e90 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:40.181446 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-60a087b9-1265-4421-80ec-f0bb8b8b9e90 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:40.183138 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-60a087b9-1265-4421-80ec-f0bb8b8b9e90 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:40.184078 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-60a087b9-1265-4421-80ec-f0bb8b8b9e90 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:40.421888 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-60a087b9-1265-4421-80ec-f0bb8b8b9e90 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:40.429441 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-60a087b9-1265-4421-80ec-f0bb8b8b9e90 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689" status: 200 len: 1317 microversion: 2.1 time: 0.270332 Feb 20 20:08:40.430131 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 325/632] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:40 2022] GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689 => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:08:40.725228 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-db2dc6a0-41fb-4aa3-943a-c16a463cc278 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Action: 'create', calling method: .version_select at 0x7fdd915648b0>, body: {"keypair": {"name": "tempest-keypair-747536135"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:08:40.742272 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-db2dc6a0-41fb-4aa3-943a-c16a463cc278 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Getting quotas for project e1bbd53d77c94e618e7f59de051406ed. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:08:40.748039 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-db2dc6a0-41fb-4aa3-943a-c16a463cc278 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Getting quotas for user 5a2f5fd619ad45a48590fa6b2ae6fb4f and project e1bbd53d77c94e618e7f59de051406ed. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:08:40.952836 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-db2dc6a0-41fb-4aa3-943a-c16a463cc278 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Getting quotas for project e1bbd53d77c94e618e7f59de051406ed. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:08:40.956776 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-db2dc6a0-41fb-4aa3-943a-c16a463cc278 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Getting quotas for user 5a2f5fd619ad45a48590fa6b2ae6fb4f and project e1bbd53d77c94e618e7f59de051406ed. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:08:40.970749 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-db2dc6a0-41fb-4aa3-943a-c16a463cc278 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.249727 Feb 20 20:08:40.971361 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 308/633] 10.222.0.60 () {62 vars in 1198 bytes} [Sun Feb 20 20:08:40 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 251 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Feb 20 20:08:41.448312 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-cb99a16b-2ca7-4db7-997d-01cbd3ab4cf4 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:41.448940 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-cb99a16b-2ca7-4db7-997d-01cbd3ab4cf4 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: bdff4760-c8ef-4f40-a118-40c44d576689] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:41.455708 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cb99a16b-2ca7-4db7-997d-01cbd3ab4cf4 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:41.456119 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cb99a16b-2ca7-4db7-997d-01cbd3ab4cf4 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:41.456932 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cb99a16b-2ca7-4db7-997d-01cbd3ab4cf4 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:41.457400 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-cb99a16b-2ca7-4db7-997d-01cbd3ab4cf4 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:41.627333 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-cb99a16b-2ca7-4db7-997d-01cbd3ab4cf4 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:41.637437 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-cb99a16b-2ca7-4db7-997d-01cbd3ab4cf4 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689" status: 200 len: 1317 microversion: 2.1 time: 0.193238 Feb 20 20:08:41.638171 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 326/634] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:41 2022] GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:42.306644 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-79295bf0-cc2a-49d7-88e5-0c6dcfc5a0b2 req-ce986276-2538-404f-9353-1a7726947d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdff4760-c8ef-4f40-a118-40c44d576689", "name": "network-vif-plugged", "status": "completed", "tag": "e80e85e5-c807-440e-b552-b5406cb0afa7"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:08:42.309761 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:08:42.309761 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:08:42.318015 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-79295bf0-cc2a-49d7-88e5-0c6dcfc5a0b2 req-ce986276-2538-404f-9353-1a7726947d46 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:42.318459 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-79295bf0-cc2a-49d7-88e5-0c6dcfc5a0b2 req-ce986276-2538-404f-9353-1a7726947d46 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:42.334804 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-79295bf0-cc2a-49d7-88e5-0c6dcfc5a0b2 req-ce986276-2538-404f-9353-1a7726947d46 service nova] Creating event network-vif-plugged:e80e85e5-c807-440e-b552-b5406cb0afa7 for instance bdff4760-c8ef-4f40-a118-40c44d576689 on hv-cinder-83008 Feb 20 20:08:42.344838 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-79295bf0-cc2a-49d7-88e5-0c6dcfc5a0b2 req-ce986276-2538-404f-9353-1a7726947d46 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040220 Feb 20 20:08:42.344838 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 309/635] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:08:42.655840 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9197b4e8-6e28-4177-b33a-7cf3dd5ded07 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:42.656685 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9197b4e8-6e28-4177-b33a-7cf3dd5ded07 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: bdff4760-c8ef-4f40-a118-40c44d576689] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:42.664453 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9197b4e8-6e28-4177-b33a-7cf3dd5ded07 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:42.665074 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9197b4e8-6e28-4177-b33a-7cf3dd5ded07 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:42.666008 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9197b4e8-6e28-4177-b33a-7cf3dd5ded07 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:42.666808 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9197b4e8-6e28-4177-b33a-7cf3dd5ded07 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:42.858267 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9197b4e8-6e28-4177-b33a-7cf3dd5ded07 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:42.867242 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9197b4e8-6e28-4177-b33a-7cf3dd5ded07 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689" status: 200 len: 1317 microversion: 2.1 time: 0.215042 Feb 20 20:08:42.867843 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 327/636] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:42 2022] GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:43.827799 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-48221278-ea29-41e6-8453-fb98d17fbf57 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-440280352", "imageRef": "61c0cc70-53e3-40ed-b353-ec1b5fc4eea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "628a481f-f881-4fc8-9417-12ed3960094e"}], "security_groups": [{"name": "tempest-securitygroup--831046503"}], "key_name": "tempest-keypair-747536135", "user_data": "}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:08:43.887330 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b56e35f3-751f-4a93-9f17-9dcb14f9188d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:43.887936 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b56e35f3-751f-4a93-9f17-9dcb14f9188d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: bdff4760-c8ef-4f40-a118-40c44d576689] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:43.895663 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b56e35f3-751f-4a93-9f17-9dcb14f9188d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:43.896256 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b56e35f3-751f-4a93-9f17-9dcb14f9188d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:43.897047 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b56e35f3-751f-4a93-9f17-9dcb14f9188d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:43.897563 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b56e35f3-751f-4a93-9f17-9dcb14f9188d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:43.980487 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.network.neutron [None req-48221278-ea29-41e6-8453-fb98d17fbf57 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] validate_networks() for [('628a481f-f881-4fc8-9417-12ed3960094e', None, None, None, None, None)] {{(pid=117087) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 20 20:08:44.224363 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b56e35f3-751f-4a93-9f17-9dcb14f9188d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:44.235370 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b56e35f3-751f-4a93-9f17-9dcb14f9188d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689" status: 200 len: 1317 microversion: 2.1 time: 0.352698 Feb 20 20:08:44.248891 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 328/637] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:43 2022] GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689 => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:08:44.248891 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bcb9c839-02b3-426b-9469-ea3fc05bd6b1 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:44.248891 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-bcb9c839-02b3-426b-9469-ea3fc05bd6b1 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:44.257412 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bcb9c839-02b3-426b-9469-ea3fc05bd6b1 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:44.258154 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bcb9c839-02b3-426b-9469-ea3fc05bd6b1 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:44.259492 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bcb9c839-02b3-426b-9469-ea3fc05bd6b1 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:44.260072 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bcb9c839-02b3-426b-9469-ea3fc05bd6b1 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:44.300118 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-bcb9c839-02b3-426b-9469-ea3fc05bd6b1 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061931 Feb 20 20:08:44.301981 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 329/638] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:08:44 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 20 20:08:44.390192 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e9385660-55fb-4167-a314-4b227b648e9d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:44.390814 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e9385660-55fb-4167-a314-4b227b648e9d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:44.397284 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e9385660-55fb-4167-a314-4b227b648e9d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:44.397746 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e9385660-55fb-4167-a314-4b227b648e9d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:44.398585 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e9385660-55fb-4167-a314-4b227b648e9d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:44.399012 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e9385660-55fb-4167-a314-4b227b648e9d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:44.443780 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e9385660-55fb-4167-a314-4b227b648e9d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 20 20:08:44.583829 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-48221278-ea29-41e6-8453-fb98d17fbf57 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Flavor limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 20 20:08:44.584340 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-48221278-ea29-41e6-8453-fb98d17fbf57 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Image limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 20 20:08:44.584914 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-48221278-ea29-41e6-8453-fb98d17fbf57 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Flavor pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 20 20:08:44.585495 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-48221278-ea29-41e6-8453-fb98d17fbf57 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Image pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 20 20:08:44.586199 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-48221278-ea29-41e6-8453-fb98d17fbf57 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 20 20:08:44.597311 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-48221278-ea29-41e6-8453-fb98d17fbf57 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:44.597761 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-48221278-ea29-41e6-8453-fb98d17fbf57 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:44.598697 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-48221278-ea29-41e6-8453-fb98d17fbf57 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:44.599130 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-48221278-ea29-41e6-8453-fb98d17fbf57 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:44.624025 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-48221278-ea29-41e6-8453-fb98d17fbf57 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Getting quotas for project e1bbd53d77c94e618e7f59de051406ed. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:08:44.631920 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-48221278-ea29-41e6-8453-fb98d17fbf57 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Getting quotas for user 5a2f5fd619ad45a48590fa6b2ae6fb4f and project e1bbd53d77c94e618e7f59de051406ed. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:08:44.652048 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-48221278-ea29-41e6-8453-fb98d17fbf57 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Going to run 1 instances... {{(pid=117087) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 20 20:08:44.656987 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-48221278-ea29-41e6-8453-fb98d17fbf57 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61c0cc70-53e3-40ed-b353-ec1b5fc4eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 20 20:08:44.862549 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-48221278-ea29-41e6-8453-fb98d17fbf57 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.043124 Feb 20 20:08:44.863666 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 310/639] 10.222.0.60 () {62 vars in 1187 bytes} [Sun Feb 20 20:08:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Feb 20 20:08:44.877748 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-868cbd37-5f93-4e1a-b922-bf23caffbf46 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:44.878581 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-868cbd37-5f93-4e1a-b922-bf23caffbf46 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:44.893830 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e9385660-55fb-4167-a314-4b227b648e9d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 204 len: 0 microversion: 2.1 time: 0.506636 Feb 20 20:08:44.898186 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 330/640] 10.222.0.60 () {58 vars in 1238 bytes} [Sun Feb 20 20:08:44 2022] DELETE /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 20 20:08:44.908453 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d3d398ca-440e-4fbd-bdff-4a45577b9031 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:44.909527 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d3d398ca-440e-4fbd-bdff-4a45577b9031 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:44.920396 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d3d398ca-440e-4fbd-bdff-4a45577b9031 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:44.923612 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d3d398ca-440e-4fbd-bdff-4a45577b9031 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:44.923612 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d3d398ca-440e-4fbd-bdff-4a45577b9031 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:44.923612 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d3d398ca-440e-4fbd-bdff-4a45577b9031 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:44.953599 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-868cbd37-5f93-4e1a-b922-bf23caffbf46 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:44.967868 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-868cbd37-5f93-4e1a-b922-bf23caffbf46 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:44.971015 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-868cbd37-5f93-4e1a-b922-bf23caffbf46 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:44.973432 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-868cbd37-5f93-4e1a-b922-bf23caffbf46 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1280 microversion: 2.20 time: 0.099426 Feb 20 20:08:44.974356 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 311/641] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:08:44 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1280 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:08:45.139833 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d3d398ca-440e-4fbd-bdff-4a45577b9031 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:45.147898 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d3d398ca-440e-4fbd-bdff-4a45577b9031 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1671 microversion: 2.1 time: 0.247772 Feb 20 20:08:45.148624 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 331/642] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:44 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1671 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:45.258793 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8394ee6a-88ba-4a19-a49b-da8a16697ee6 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:45.259467 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8394ee6a-88ba-4a19-a49b-da8a16697ee6 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: bdff4760-c8ef-4f40-a118-40c44d576689] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:45.266783 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8394ee6a-88ba-4a19-a49b-da8a16697ee6 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:45.267216 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8394ee6a-88ba-4a19-a49b-da8a16697ee6 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:45.267989 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8394ee6a-88ba-4a19-a49b-da8a16697ee6 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:45.268416 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8394ee6a-88ba-4a19-a49b-da8a16697ee6 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:45.435091 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8394ee6a-88ba-4a19-a49b-da8a16697ee6 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:45.443045 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8394ee6a-88ba-4a19-a49b-da8a16697ee6 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689" status: 200 len: 1508 microversion: 2.1 time: 0.190560 Feb 20 20:08:45.443643 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 312/643] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:45 2022] GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689 => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:45.465542 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3a3fa577-ae41-4055-b66b-3477d9186a7d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6919ad44-c301-4a2b-8569-9b567386d0ad"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:08:45.467565 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-3a3fa577-ae41-4055-b66b-3477d9186a7d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: bdff4760-c8ef-4f40-a118-40c44d576689] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:45.478220 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3a3fa577-ae41-4055-b66b-3477d9186a7d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:45.479593 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3a3fa577-ae41-4055-b66b-3477d9186a7d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:45.480995 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3a3fa577-ae41-4055-b66b-3477d9186a7d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:45.481796 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3a3fa577-ae41-4055-b66b-3477d9186a7d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:45.582403 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-3a3fa577-ae41-4055-b66b-3477d9186a7d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] HTTP exception thrown: Invalid volume: volume 6919ad44-c301-4a2b-8569-9b567386d0ad is already attached to instances: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 Feb 20 20:08:45.583007 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3a3fa577-ae41-4055-b66b-3477d9186a7d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Returning 400 to user: Invalid volume: volume 6919ad44-c301-4a2b-8569-9b567386d0ad is already attached to instances: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:08:45.583847 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-3a3fa577-ae41-4055-b66b-3477d9186a7d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "POST /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.126645 Feb 20 20:08:45.584428 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 332/644] 10.222.0.60 () {60 vars in 1322 bytes} [Sun Feb 20 20:08:45 2022] POST /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689/os-volume_attachments => generated 174 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 20 20:08:45.663907 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1e2ed3cb-743b-4728-8efe-7519480fe4cb tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:45.664524 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1e2ed3cb-743b-4728-8efe-7519480fe4cb tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:45.672960 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1e2ed3cb-743b-4728-8efe-7519480fe4cb tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:45.673567 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1e2ed3cb-743b-4728-8efe-7519480fe4cb tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:45.674546 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1e2ed3cb-743b-4728-8efe-7519480fe4cb tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:45.675448 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1e2ed3cb-743b-4728-8efe-7519480fe4cb tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:45.775537 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-1e2ed3cb-743b-4728-8efe-7519480fe4cb tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lazy-loading 'services' on Instance uuid c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:08:45.998395 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5e9ae821-7a40-45e9-ace6-eea1e26855f0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:45.999245 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5e9ae821-7a40-45e9-ace6-eea1e26855f0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:46.009532 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5e9ae821-7a40-45e9-ace6-eea1e26855f0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:46.010071 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5e9ae821-7a40-45e9-ace6-eea1e26855f0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:46.010906 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5e9ae821-7a40-45e9-ace6-eea1e26855f0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:46.011351 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5e9ae821-7a40-45e9-ace6-eea1e26855f0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:46.035218 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1e2ed3cb-743b-4728-8efe-7519480fe4cb tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403/os-volume_attachments/6919ad44-c301-4a2b-8569-9b567386d0ad" status: 202 len: 0 microversion: 2.1 time: 0.374912 Feb 20 20:08:46.036232 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 313/645] 10.222.0.60 () {58 vars in 1415 bytes} [Sun Feb 20 20:08:45 2022] DELETE /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403/os-volume_attachments/6919ad44-c301-4a2b-8569-9b567386d0ad => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 20 20:08:46.050241 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2ac6a8fb-8674-4f94-9b84-ddcb478adc3d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:46.051419 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2ac6a8fb-8674-4f94-9b84-ddcb478adc3d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:46.058914 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ac6a8fb-8674-4f94-9b84-ddcb478adc3d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:46.060753 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ac6a8fb-8674-4f94-9b84-ddcb478adc3d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:46.060753 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ac6a8fb-8674-4f94-9b84-ddcb478adc3d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:46.060753 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2ac6a8fb-8674-4f94-9b84-ddcb478adc3d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:46.106798 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2ac6a8fb-8674-4f94-9b84-ddcb478adc3d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062534 Feb 20 20:08:46.108667 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 314/646] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:08:46 2022] GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:08:46.111921 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5e9ae821-7a40-45e9-ace6-eea1e26855f0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:46.123419 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5e9ae821-7a40-45e9-ace6-eea1e26855f0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:46.124971 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5e9ae821-7a40-45e9-ace6-eea1e26855f0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:46.127215 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5e9ae821-7a40-45e9-ace6-eea1e26855f0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1284 microversion: 2.20 time: 0.133565 Feb 20 20:08:46.127215 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 333/647] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:08:45 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:08:46.167942 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-16e63c22-dcbb-4623-9581-86f2cbf564f5 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:46.168512 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-16e63c22-dcbb-4623-9581-86f2cbf564f5 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:46.175230 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-16e63c22-dcbb-4623-9581-86f2cbf564f5 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:46.175685 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-16e63c22-dcbb-4623-9581-86f2cbf564f5 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:46.176531 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-16e63c22-dcbb-4623-9581-86f2cbf564f5 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:46.177029 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-16e63c22-dcbb-4623-9581-86f2cbf564f5 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:46.380696 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-16e63c22-dcbb-4623-9581-86f2cbf564f5 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:46.397757 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-16e63c22-dcbb-4623-9581-86f2cbf564f5 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1671 microversion: 2.1 time: 0.232239 Feb 20 20:08:46.397757 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 315/648] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:46 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1671 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:47.127142 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6007175d-bf53-4846-aa68-40026e2f6ebb tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:47.129604 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6007175d-bf53-4846-aa68-40026e2f6ebb tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:47.141580 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6007175d-bf53-4846-aa68-40026e2f6ebb tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:47.142410 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6007175d-bf53-4846-aa68-40026e2f6ebb tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:47.144090 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6007175d-bf53-4846-aa68-40026e2f6ebb tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:47.144867 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6007175d-bf53-4846-aa68-40026e2f6ebb tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:47.149655 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e36bba34-17fd-42b7-b6ac-8fff360d80aa tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:47.151416 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e36bba34-17fd-42b7-b6ac-8fff360d80aa tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:47.162581 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e36bba34-17fd-42b7-b6ac-8fff360d80aa tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:47.163325 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e36bba34-17fd-42b7-b6ac-8fff360d80aa tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:47.164458 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e36bba34-17fd-42b7-b6ac-8fff360d80aa tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:47.165215 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e36bba34-17fd-42b7-b6ac-8fff360d80aa tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:47.204261 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6007175d-bf53-4846-aa68-40026e2f6ebb tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085260 Feb 20 20:08:47.205542 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 334/649] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:08:47 2022] GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:08:47.348619 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e36bba34-17fd-42b7-b6ac-8fff360d80aa tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:47.360825 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e36bba34-17fd-42b7-b6ac-8fff360d80aa tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:47.363833 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e36bba34-17fd-42b7-b6ac-8fff360d80aa tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:47.365890 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e36bba34-17fd-42b7-b6ac-8fff360d80aa tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1332 microversion: 2.20 time: 0.223052 Feb 20 20:08:47.367120 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 316/650] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:08:47 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1332 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:08:47.418949 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b6562db2-862f-4fe2-8af3-7d1615ce12c7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:47.419770 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b6562db2-862f-4fe2-8af3-7d1615ce12c7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:47.427207 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b6562db2-862f-4fe2-8af3-7d1615ce12c7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:47.435857 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b6562db2-862f-4fe2-8af3-7d1615ce12c7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:47.435857 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b6562db2-862f-4fe2-8af3-7d1615ce12c7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:47.435857 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b6562db2-862f-4fe2-8af3-7d1615ce12c7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:47.757697 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b6562db2-862f-4fe2-8af3-7d1615ce12c7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:47.773038 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b6562db2-862f-4fe2-8af3-7d1615ce12c7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1671 microversion: 2.1 time: 0.357571 Feb 20 20:08:47.774017 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 335/651] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:47 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1671 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:48.225826 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-db09c80b-5fd1-4e18-9f2f-db3aba878916 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:48.228642 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-db09c80b-5fd1-4e18-9f2f-db3aba878916 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:48.242766 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-db09c80b-5fd1-4e18-9f2f-db3aba878916 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:48.243435 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-db09c80b-5fd1-4e18-9f2f-db3aba878916 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:48.246514 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-db09c80b-5fd1-4e18-9f2f-db3aba878916 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:48.247290 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-db09c80b-5fd1-4e18-9f2f-db3aba878916 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:48.310090 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-db09c80b-5fd1-4e18-9f2f-db3aba878916 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092163 Feb 20 20:08:48.311188 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 317/652] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:08:48 2022] GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 20 20:08:48.411710 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c710344d-2713-4712-b8ae-fe32e277cc01 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:48.414242 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c710344d-2713-4712-b8ae-fe32e277cc01 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:48.430082 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c710344d-2713-4712-b8ae-fe32e277cc01 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:48.431208 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c710344d-2713-4712-b8ae-fe32e277cc01 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:48.433899 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c710344d-2713-4712-b8ae-fe32e277cc01 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:48.435035 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c710344d-2713-4712-b8ae-fe32e277cc01 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:48.482611 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-141960b6-e4e0-48c8-a396-53014c94ad88 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2016367695", "imageRef": "61c0cc70-53e3-40ed-b353-ec1b5fc4eea4", "flavorRef": "452", "networks": [{"uuid": "8b2a19f4-c94f-444f-9511-f39cc6853442"}]}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:08:48.557030 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.network.neutron [None req-141960b6-e4e0-48c8-a396-53014c94ad88 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] validate_networks() for [('8b2a19f4-c94f-444f-9511-f39cc6853442', None, None, None, None, None)] {{(pid=117087) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 20 20:08:48.565301 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c710344d-2713-4712-b8ae-fe32e277cc01 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:48.583256 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c710344d-2713-4712-b8ae-fe32e277cc01 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:48.587172 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c710344d-2713-4712-b8ae-fe32e277cc01 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:48.590168 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c710344d-2713-4712-b8ae-fe32e277cc01 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1338 microversion: 2.20 time: 0.201251 Feb 20 20:08:48.591284 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 336/653] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:08:48 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1338 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:08:48.798351 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-407dc813-6a90-485c-839a-f89ecdf34b43 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:48.799774 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-407dc813-6a90-485c-839a-f89ecdf34b43 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:48.822256 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-407dc813-6a90-485c-839a-f89ecdf34b43 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:48.824041 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-407dc813-6a90-485c-839a-f89ecdf34b43 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:48.825543 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-407dc813-6a90-485c-839a-f89ecdf34b43 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:48.826315 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-407dc813-6a90-485c-839a-f89ecdf34b43 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:49.767565 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-407dc813-6a90-485c-839a-f89ecdf34b43 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:49.778959 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-407dc813-6a90-485c-839a-f89ecdf34b43 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1671 microversion: 2.1 time: 0.984828 Feb 20 20:08:49.779858 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 337/654] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:48 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1671 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:49.784917 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a9b02048-5496-4cdf-b985-e547b087b724 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:49.785680 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a9b02048-5496-4cdf-b985-e547b087b724 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:49.801005 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a9b02048-5496-4cdf-b985-e547b087b724 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:49.801975 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a9b02048-5496-4cdf-b985-e547b087b724 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:49.803898 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-141960b6-e4e0-48c8-a396-53014c94ad88 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Flavor limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 20 20:08:49.804710 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a9b02048-5496-4cdf-b985-e547b087b724 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:49.804891 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-141960b6-e4e0-48c8-a396-53014c94ad88 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Image limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 20 20:08:49.805296 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-141960b6-e4e0-48c8-a396-53014c94ad88 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Flavor pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 20 20:08:49.805919 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-141960b6-e4e0-48c8-a396-53014c94ad88 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Image pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 20 20:08:49.806579 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-141960b6-e4e0-48c8-a396-53014c94ad88 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 20 20:08:49.807592 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a9b02048-5496-4cdf-b985-e547b087b724 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:49.830392 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-141960b6-e4e0-48c8-a396-53014c94ad88 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:49.831742 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-141960b6-e4e0-48c8-a396-53014c94ad88 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:49.832830 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-141960b6-e4e0-48c8-a396-53014c94ad88 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:49.833313 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-141960b6-e4e0-48c8-a396-53014c94ad88 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:49.866553 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-141960b6-e4e0-48c8-a396-53014c94ad88 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Getting quotas for project 79884d2db8f34ea3a56bb24700c0834b. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:08:49.872043 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-141960b6-e4e0-48c8-a396-53014c94ad88 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Getting quotas for user 3c74b25bf2e94447ab74a7e157eadac7 and project 79884d2db8f34ea3a56bb24700c0834b. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:08:49.892608 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-141960b6-e4e0-48c8-a396-53014c94ad88 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Going to run 1 instances... {{(pid=117087) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 20 20:08:49.896428 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-141960b6-e4e0-48c8-a396-53014c94ad88 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61c0cc70-53e3-40ed-b353-ec1b5fc4eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 20 20:08:50.029768 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-141960b6-e4e0-48c8-a396-53014c94ad88 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.554438 Feb 20 20:08:50.031026 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 318/655] 10.222.0.60 () {60 vars in 1146 bytes} [Sun Feb 20 20:08:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 20 20:08:50.048424 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c788f308-4227-4e8f-a01d-96203082a4cd tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:50.063836 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c788f308-4227-4e8f-a01d-96203082a4cd tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:50.223614 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c788f308-4227-4e8f-a01d-96203082a4cd tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:50.281162 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c788f308-4227-4e8f-a01d-96203082a4cd tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865" status: 200 len: 1218 microversion: 2.1 time: 0.239307 Feb 20 20:08:50.282187 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 319/656] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:50 2022] GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865 => generated 1218 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:08:50.545498 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-f3585569-60d5-4038-a799-112bd5cb721b req-7c57a6e8-a07e-4043-9ba3-5c05d1e462ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6", "name": "network-vif-deleted", "tag": "902a9701-9d4c-46bc-961e-7f1df743d7d7"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:08:50.562459 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:08:50.562459 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:08:50.599304 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-f3585569-60d5-4038-a799-112bd5cb721b req-7c57a6e8-a07e-4043-9ba3-5c05d1e462ca service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:50.600791 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-f3585569-60d5-4038-a799-112bd5cb721b req-7c57a6e8-a07e-4043-9ba3-5c05d1e462ca service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:50.636846 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-f3585569-60d5-4038-a799-112bd5cb721b req-7c57a6e8-a07e-4043-9ba3-5c05d1e462ca service nova] Creating event network-vif-deleted:902a9701-9d4c-46bc-961e-7f1df743d7d7 for instance ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 on hv-cinder-83008 Feb 20 20:08:50.648183 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-f3585569-60d5-4038-a799-112bd5cb721b req-7c57a6e8-a07e-4043-9ba3-5c05d1e462ca service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110767 Feb 20 20:08:50.649315 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 320/657] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:08:50.710198 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a9b02048-5496-4cdf-b985-e547b087b724 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:50.736881 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a9b02048-5496-4cdf-b985-e547b087b724 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:50.742599 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a9b02048-5496-4cdf-b985-e547b087b724 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:50.745480 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a9b02048-5496-4cdf-b985-e547b087b724 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1405 microversion: 2.20 time: 0.963402 Feb 20 20:08:50.755488 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 338/658] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:08:49 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1405 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:08:50.808169 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-0651cb31-10c4-4257-b09f-c0afcc51100d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:50.809632 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-0651cb31-10c4-4257-b09f-c0afcc51100d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:50.834835 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0651cb31-10c4-4257-b09f-c0afcc51100d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:50.835814 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0651cb31-10c4-4257-b09f-c0afcc51100d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:50.837755 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0651cb31-10c4-4257-b09f-c0afcc51100d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:50.838540 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0651cb31-10c4-4257-b09f-c0afcc51100d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:50.935932 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-d5320af5-770e-466f-920b-db4a4cde76e8 req-2a99df6e-81e4-4fd6-ba67-7f8a7eea0d47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2f60f31-e3e4-4705-910a-d01bdba1d965", "tag": "1a899be1-fae4-4e55-ab37-e5b2c436daf0"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:08:50.943531 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:08:50.943531 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:08:50.984291 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-d5320af5-770e-466f-920b-db4a4cde76e8 req-2a99df6e-81e4-4fd6-ba67-7f8a7eea0d47 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:50.985029 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-d5320af5-770e-466f-920b-db4a4cde76e8 req-2a99df6e-81e4-4fd6-ba67-7f8a7eea0d47 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:51.005876 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0651cb31-10c4-4257-b09f-c0afcc51100d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:51.007703 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-d5320af5-770e-466f-920b-db4a4cde76e8 req-2a99df6e-81e4-4fd6-ba67-7f8a7eea0d47 service nova] Creating event network-changed:1a899be1-fae4-4e55-ab37-e5b2c436daf0 for instance d2f60f31-e3e4-4705-910a-d01bdba1d965 on hv-cinder-83008 Feb 20 20:08:51.014231 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-d5320af5-770e-466f-920b-db4a4cde76e8 req-2a99df6e-81e4-4fd6-ba67-7f8a7eea0d47 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095865 Feb 20 20:08:51.018425 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 339/659] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:08:51.023182 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-0651cb31-10c4-4257-b09f-c0afcc51100d tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1321 microversion: 2.1 time: 0.224587 Feb 20 20:08:51.025355 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 321/660] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:50 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:51.312436 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3d93f078-959d-4a03-8e74-aa289f707541 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:51.313205 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-3d93f078-959d-4a03-8e74-aa289f707541 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:51.411938 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3d93f078-959d-4a03-8e74-aa289f707541 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:51.422324 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-3d93f078-959d-4a03-8e74-aa289f707541 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865" status: 200 len: 1218 microversion: 2.1 time: 0.112431 Feb 20 20:08:51.424093 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 340/661] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:51 2022] GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865 => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:51.774689 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3c3964d3-31af-4704-847f-177185f5b354 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:51.782563 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3c3964d3-31af-4704-847f-177185f5b354 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:51.786278 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3c3964d3-31af-4704-847f-177185f5b354 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:51.786975 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3c3964d3-31af-4704-847f-177185f5b354 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:51.788123 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3c3964d3-31af-4704-847f-177185f5b354 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:51.788703 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3c3964d3-31af-4704-847f-177185f5b354 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:52.023319 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3c3964d3-31af-4704-847f-177185f5b354 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:52.040381 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3c3964d3-31af-4704-847f-177185f5b354 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:52.044180 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-18502f48-5faa-4ac2-8fff-fc65684960eb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:52.045183 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-18502f48-5faa-4ac2-8fff-fc65684960eb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:52.053449 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-18502f48-5faa-4ac2-8fff-fc65684960eb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:52.053934 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3c3964d3-31af-4704-847f-177185f5b354 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:52.054650 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-18502f48-5faa-4ac2-8fff-fc65684960eb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:52.056178 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-18502f48-5faa-4ac2-8fff-fc65684960eb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:52.056890 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-18502f48-5faa-4ac2-8fff-fc65684960eb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:52.058200 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3c3964d3-31af-4704-847f-177185f5b354 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1405 microversion: 2.20 time: 0.287576 Feb 20 20:08:52.058953 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 322/662] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:08:51 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1405 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:08:52.112311 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-18502f48-5faa-4ac2-8fff-fc65684960eb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:52.112311 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-18502f48-5faa-4ac2-8fff-fc65684960eb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:52.112311 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-18502f48-5faa-4ac2-8fff-fc65684960eb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lazy-loading 'fault' on Instance uuid ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:08:52.174293 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-18502f48-5faa-4ac2-8fff-fc65684960eb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:52.188140 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-18502f48-5faa-4ac2-8fff-fc65684960eb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 200 len: 1326 microversion: 2.1 time: 0.149627 Feb 20 20:08:52.188362 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 341/663] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:52 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 1326 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:52.453764 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c0a3dc5a-b8c5-4635-8742-b3e6f739e16c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:52.453764 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c0a3dc5a-b8c5-4635-8742-b3e6f739e16c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:52.459977 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c0a3dc5a-b8c5-4635-8742-b3e6f739e16c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:52.460420 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c0a3dc5a-b8c5-4635-8742-b3e6f739e16c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:52.461223 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c0a3dc5a-b8c5-4635-8742-b3e6f739e16c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:52.461658 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c0a3dc5a-b8c5-4635-8742-b3e6f739e16c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:52.534156 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c0a3dc5a-b8c5-4635-8742-b3e6f739e16c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:52.546795 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c0a3dc5a-b8c5-4635-8742-b3e6f739e16c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865" status: 200 len: 1214 microversion: 2.1 time: 0.098662 Feb 20 20:08:52.556215 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 323/664] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:52 2022] GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865 => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:08:53.102217 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-91f32507-9fc3-4993-836f-98b2279b5945 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:53.103804 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-91f32507-9fc3-4993-836f-98b2279b5945 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:53.114125 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-91f32507-9fc3-4993-836f-98b2279b5945 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:53.114569 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-91f32507-9fc3-4993-836f-98b2279b5945 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:53.115362 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-91f32507-9fc3-4993-836f-98b2279b5945 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:53.115788 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-91f32507-9fc3-4993-836f-98b2279b5945 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:53.215244 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a45d6fa5-418b-4118-b01c-abe63ca95503 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:53.216300 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a45d6fa5-418b-4118-b01c-abe63ca95503 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:53.224347 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a45d6fa5-418b-4118-b01c-abe63ca95503 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:53.224795 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a45d6fa5-418b-4118-b01c-abe63ca95503 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:53.225627 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a45d6fa5-418b-4118-b01c-abe63ca95503 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:53.226059 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a45d6fa5-418b-4118-b01c-abe63ca95503 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:53.241203 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-a45d6fa5-418b-4118-b01c-abe63ca95503 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] HTTP exception thrown: Instance ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 could not be found. Feb 20 20:08:53.241801 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a45d6fa5-418b-4118-b01c-abe63ca95503 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Returning 404 to user: Instance ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:08:53.242641 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a45d6fa5-418b-4118-b01c-abe63ca95503 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 404 len: 111 microversion: 2.1 time: 0.033168 Feb 20 20:08:53.243216 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 324/665] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:53 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 20 20:08:53.252423 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8d7a7c6d-1ca1-47d4-bbe2-2d75c396fb26 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '.version_select at 0x7fdd91564e50>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:53.328457 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-91f32507-9fc3-4993-836f-98b2279b5945 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:53.339120 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-91f32507-9fc3-4993-836f-98b2279b5945 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:53.341149 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-91f32507-9fc3-4993-836f-98b2279b5945 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:53.342261 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-91f32507-9fc3-4993-836f-98b2279b5945 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1405 microversion: 2.20 time: 0.246571 Feb 20 20:08:53.342914 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 342/666] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:08:53 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1405 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:08:53.362375 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8d7a7c6d-1ca1-47d4-bbe2-2d75c396fb26 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-362631716" status: 202 len: 0 microversion: 2.1 time: 0.113440 Feb 20 20:08:53.362940 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 325/667] 10.222.0.60 () {58 vars in 1217 bytes} [Sun Feb 20 20:08:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-362631716 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:08:53.575451 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2db29ea4-1f02-4cbd-83ac-c96623819ea9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:53.576568 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2db29ea4-1f02-4cbd-83ac-c96623819ea9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:53.587011 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2db29ea4-1f02-4cbd-83ac-c96623819ea9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:53.588433 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2db29ea4-1f02-4cbd-83ac-c96623819ea9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:53.589610 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2db29ea4-1f02-4cbd-83ac-c96623819ea9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:53.590373 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2db29ea4-1f02-4cbd-83ac-c96623819ea9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:53.699381 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2db29ea4-1f02-4cbd-83ac-c96623819ea9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:53.712084 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2db29ea4-1f02-4cbd-83ac-c96623819ea9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865" status: 200 len: 1270 microversion: 2.1 time: 0.141944 Feb 20 20:08:53.712084 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 343/668] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:53 2022] GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865 => generated 1270 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:54.364261 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-acd40b9f-0adf-4211-93e6-0f8b3d5e0a6c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:54.365483 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-acd40b9f-0adf-4211-93e6-0f8b3d5e0a6c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:54.384592 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-acd40b9f-0adf-4211-93e6-0f8b3d5e0a6c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:54.385355 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-acd40b9f-0adf-4211-93e6-0f8b3d5e0a6c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:54.386751 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-acd40b9f-0adf-4211-93e6-0f8b3d5e0a6c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:54.387500 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-acd40b9f-0adf-4211-93e6-0f8b3d5e0a6c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:54.567241 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-acd40b9f-0adf-4211-93e6-0f8b3d5e0a6c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:54.577499 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-acd40b9f-0adf-4211-93e6-0f8b3d5e0a6c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:54.579191 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-acd40b9f-0adf-4211-93e6-0f8b3d5e0a6c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:54.580402 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-acd40b9f-0adf-4211-93e6-0f8b3d5e0a6c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1405 microversion: 2.20 time: 0.220897 Feb 20 20:08:54.581380 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 326/669] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:08:54 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:08:54.739491 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a7153b9b-aaad-4d58-af5c-322aa979a247 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:54.740398 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a7153b9b-aaad-4d58-af5c-322aa979a247 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:54.754548 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a7153b9b-aaad-4d58-af5c-322aa979a247 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:54.755349 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a7153b9b-aaad-4d58-af5c-322aa979a247 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:54.756775 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a7153b9b-aaad-4d58-af5c-322aa979a247 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:54.757291 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a7153b9b-aaad-4d58-af5c-322aa979a247 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:54.839870 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a7153b9b-aaad-4d58-af5c-322aa979a247 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:54.853453 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a7153b9b-aaad-4d58-af5c-322aa979a247 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865" status: 200 len: 1276 microversion: 2.1 time: 0.120386 Feb 20 20:08:54.854543 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 344/670] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:54 2022] GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865 => generated 1276 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:54.989452 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7b86c614-11f6-42d7-9b95-86480ae85373 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Action: 'create', calling method: .version_select at 0x7fdd91577160>, body: {"keypair": {"name": "tempest-keypair-202645246"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:08:55.016854 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-7b86c614-11f6-42d7-9b95-86480ae85373 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Getting quotas for project 27dde5e056c34a6a9fdf78ab276c3fc6. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:08:55.024866 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-7b86c614-11f6-42d7-9b95-86480ae85373 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Getting quotas for user aa60c0b71ba54f37b0a45b330f9683c9 and project 27dde5e056c34a6a9fdf78ab276c3fc6. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:08:55.254017 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-7b86c614-11f6-42d7-9b95-86480ae85373 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Getting quotas for project 27dde5e056c34a6a9fdf78ab276c3fc6. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:08:55.258483 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-7b86c614-11f6-42d7-9b95-86480ae85373 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Getting quotas for user aa60c0b71ba54f37b0a45b330f9683c9 and project 27dde5e056c34a6a9fdf78ab276c3fc6. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:08:55.274674 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7b86c614-11f6-42d7-9b95-86480ae85373 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.291918 Feb 20 20:08:55.275227 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 327/671] 10.222.0.60 () {60 vars in 1157 bytes} [Sun Feb 20 20:08:54 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:55.604791 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8acee689-30b1-4434-bb09-1da80cc7eec6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:55.606017 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8acee689-30b1-4434-bb09-1da80cc7eec6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:55.616175 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8acee689-30b1-4434-bb09-1da80cc7eec6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:55.616959 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8acee689-30b1-4434-bb09-1da80cc7eec6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:55.618808 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8acee689-30b1-4434-bb09-1da80cc7eec6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:55.620216 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8acee689-30b1-4434-bb09-1da80cc7eec6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:55.875695 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8acee689-30b1-4434-bb09-1da80cc7eec6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:55.884766 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a42de412-ce71-4a65-b6f7-f4db49b0e3bd tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:55.890852 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a42de412-ce71-4a65-b6f7-f4db49b0e3bd tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:55.893138 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8acee689-30b1-4434-bb09-1da80cc7eec6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:55.896109 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8acee689-30b1-4434-bb09-1da80cc7eec6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:55.898614 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8acee689-30b1-4434-bb09-1da80cc7eec6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1405 microversion: 2.20 time: 0.300685 Feb 20 20:08:55.900380 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 345/672] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:08:55 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1405 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:08:55.904113 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a42de412-ce71-4a65-b6f7-f4db49b0e3bd tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:55.905206 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a42de412-ce71-4a65-b6f7-f4db49b0e3bd tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:55.906590 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a42de412-ce71-4a65-b6f7-f4db49b0e3bd tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:55.907775 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a42de412-ce71-4a65-b6f7-f4db49b0e3bd tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:56.115639 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a42de412-ce71-4a65-b6f7-f4db49b0e3bd tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:56.125748 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a42de412-ce71-4a65-b6f7-f4db49b0e3bd tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865" status: 200 len: 1318 microversion: 2.1 time: 0.247245 Feb 20 20:08:56.126483 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 328/673] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:55 2022] GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:56.927728 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3c928a84-c400-4356-9927-75b02472577e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:56.928659 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-3c928a84-c400-4356-9927-75b02472577e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:56.950225 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-fca456f7-e123-4c78-a887-dde3c9e307d7 req-d64d705d-2c44-4d7f-8b4d-500b85da02f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "663894bf-b677-40cf-8c2f-db3bc1531865", "tag": "04c29bfa-c7dd-4a87-8d83-65625078dd50"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:08:56.956357 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:08:56.956357 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:08:56.961977 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3c928a84-c400-4356-9927-75b02472577e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:56.962604 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3c928a84-c400-4356-9927-75b02472577e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:56.964746 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3c928a84-c400-4356-9927-75b02472577e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:56.965361 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3c928a84-c400-4356-9927-75b02472577e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:56.972296 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-fca456f7-e123-4c78-a887-dde3c9e307d7 req-d64d705d-2c44-4d7f-8b4d-500b85da02f2 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:56.972960 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-fca456f7-e123-4c78-a887-dde3c9e307d7 req-d64d705d-2c44-4d7f-8b4d-500b85da02f2 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:56.997541 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-fca456f7-e123-4c78-a887-dde3c9e307d7 req-d64d705d-2c44-4d7f-8b4d-500b85da02f2 service nova] Creating event network-changed:04c29bfa-c7dd-4a87-8d83-65625078dd50 for instance 663894bf-b677-40cf-8c2f-db3bc1531865 on hv-cinder-83008 Feb 20 20:08:57.006434 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-fca456f7-e123-4c78-a887-dde3c9e307d7 req-d64d705d-2c44-4d7f-8b4d-500b85da02f2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064646 Feb 20 20:08:57.007995 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 329/674] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:08:57.159317 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a80b36de-d102-483f-8c70-afc67fb8cb84 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:57.162659 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a80b36de-d102-483f-8c70-afc67fb8cb84 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:57.174770 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a80b36de-d102-483f-8c70-afc67fb8cb84 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:57.175992 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a80b36de-d102-483f-8c70-afc67fb8cb84 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:57.177942 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a80b36de-d102-483f-8c70-afc67fb8cb84 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:57.179105 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a80b36de-d102-483f-8c70-afc67fb8cb84 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:57.250568 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3c928a84-c400-4356-9927-75b02472577e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:57.270831 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3c928a84-c400-4356-9927-75b02472577e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:57.275053 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3c928a84-c400-4356-9927-75b02472577e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:57.282863 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-3c928a84-c400-4356-9927-75b02472577e tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1405 microversion: 2.20 time: 0.359541 Feb 20 20:08:57.285645 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 346/675] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:08:56 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1405 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:08:57.519533 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a80b36de-d102-483f-8c70-afc67fb8cb84 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:57.530676 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a80b36de-d102-483f-8c70-afc67fb8cb84 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865" status: 200 len: 1318 microversion: 2.1 time: 0.378098 Feb 20 20:08:57.543761 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 330/676] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:57 2022] GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865 => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:58.310000 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b6ce0a59-b895-4575-bdc5-099d67a62119 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:58.310579 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b6ce0a59-b895-4575-bdc5-099d67a62119 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:58.319402 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b6ce0a59-b895-4575-bdc5-099d67a62119 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:58.320487 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b6ce0a59-b895-4575-bdc5-099d67a62119 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:58.321970 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b6ce0a59-b895-4575-bdc5-099d67a62119 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:58.322814 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b6ce0a59-b895-4575-bdc5-099d67a62119 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:58.562635 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9f111304-2772-4942-ab7e-c74dbbb992c5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:58.562635 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9f111304-2772-4942-ab7e-c74dbbb992c5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:58.569708 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9f111304-2772-4942-ab7e-c74dbbb992c5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:58.570168 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9f111304-2772-4942-ab7e-c74dbbb992c5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:58.570968 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9f111304-2772-4942-ab7e-c74dbbb992c5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:58.571726 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9f111304-2772-4942-ab7e-c74dbbb992c5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:58.589810 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b6ce0a59-b895-4575-bdc5-099d67a62119 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:58.601614 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b6ce0a59-b895-4575-bdc5-099d67a62119 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:58.604204 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b6ce0a59-b895-4575-bdc5-099d67a62119 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:58.606434 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b6ce0a59-b895-4575-bdc5-099d67a62119 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1405 microversion: 2.20 time: 0.300092 Feb 20 20:08:58.607460 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 347/677] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:08:58 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1405 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:08:58.751963 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-9f111304-2772-4942-ab7e-c74dbbb992c5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:58.765032 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9f111304-2772-4942-ab7e-c74dbbb992c5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865" status: 200 len: 1318 microversion: 2.1 time: 0.216225 Feb 20 20:08:58.766087 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 331/678] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:58 2022] GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:08:58.831181 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-17f036da-68c8-432f-ac14-5526069a06fe tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1092740124", "imageRef": "61c0cc70-53e3-40ed-b353-ec1b5fc4eea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "071c382c-ea33-42d9-9b4c-49dc8158480b"}], "security_groups": [{"name": "tempest-securitygroup--1475607618"}], "key_name": "tempest-keypair-202645246", "user_data": "}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:08:59.009864 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.network.neutron [None req-17f036da-68c8-432f-ac14-5526069a06fe tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] validate_networks() for [('071c382c-ea33-42d9-9b4c-49dc8158480b', None, None, None, None, None)] {{(pid=117088) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 20 20:08:59.486730 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-17f036da-68c8-432f-ac14-5526069a06fe tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Flavor limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 20 20:08:59.487475 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-17f036da-68c8-432f-ac14-5526069a06fe tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Image limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 20 20:08:59.487941 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-17f036da-68c8-432f-ac14-5526069a06fe tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Flavor pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 20 20:08:59.488395 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-17f036da-68c8-432f-ac14-5526069a06fe tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Image pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 20 20:08:59.488871 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-17f036da-68c8-432f-ac14-5526069a06fe tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 20 20:08:59.500469 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-17f036da-68c8-432f-ac14-5526069a06fe tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:59.500926 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-17f036da-68c8-432f-ac14-5526069a06fe tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:59.501776 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-17f036da-68c8-432f-ac14-5526069a06fe tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:59.502215 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-17f036da-68c8-432f-ac14-5526069a06fe tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:59.520504 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-17f036da-68c8-432f-ac14-5526069a06fe tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Getting quotas for project 27dde5e056c34a6a9fdf78ab276c3fc6. Resources: {'instances', 'cores', 'ram'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:08:59.525619 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-17f036da-68c8-432f-ac14-5526069a06fe tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Getting quotas for user aa60c0b71ba54f37b0a45b330f9683c9 and project 27dde5e056c34a6a9fdf78ab276c3fc6. Resources: {'instances', 'cores', 'ram'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:08:59.540593 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-17f036da-68c8-432f-ac14-5526069a06fe tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Going to run 1 instances... {{(pid=117088) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 20 20:08:59.545875 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-17f036da-68c8-432f-ac14-5526069a06fe tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61c0cc70-53e3-40ed-b353-ec1b5fc4eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 20 20:08:59.627126 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-daaf7110-c8f7-4bb1-b481-d9c0899fc7c7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:59.628025 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-daaf7110-c8f7-4bb1-b481-d9c0899fc7c7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:59.634625 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-daaf7110-c8f7-4bb1-b481-d9c0899fc7c7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:59.635806 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-daaf7110-c8f7-4bb1-b481-d9c0899fc7c7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:59.636747 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-daaf7110-c8f7-4bb1-b481-d9c0899fc7c7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:59.637213 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-daaf7110-c8f7-4bb1-b481-d9c0899fc7c7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:59.713637 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-17f036da-68c8-432f-ac14-5526069a06fe tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.890476 Feb 20 20:08:59.715388 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 348/679] 10.222.0.60 () {60 vars in 1146 bytes} [Sun Feb 20 20:08:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 20 20:08:59.724695 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f6825fb7-9633-4d26-97c7-08985763562b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:59.725339 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f6825fb7-9633-4d26-97c7-08985763562b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:59.815439 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f6825fb7-9633-4d26-97c7-08985763562b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:59.823546 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f6825fb7-9633-4d26-97c7-08985763562b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 200 len: 1237 microversion: 2.1 time: 0.102347 Feb 20 20:08:59.824471 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 349/680] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:59 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 1237 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:08:59.829111 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bc278b21-0c3b-4b95-8557-fb910e303aac tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:08:59.829915 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-bc278b21-0c3b-4b95-8557-fb910e303aac tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:08:59.848561 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bc278b21-0c3b-4b95-8557-fb910e303aac tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:59.849174 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bc278b21-0c3b-4b95-8557-fb910e303aac tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:59.850074 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bc278b21-0c3b-4b95-8557-fb910e303aac tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:08:59.850513 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bc278b21-0c3b-4b95-8557-fb910e303aac tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:08:59.895184 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-daaf7110-c8f7-4bb1-b481-d9c0899fc7c7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:59.909155 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-daaf7110-c8f7-4bb1-b481-d9c0899fc7c7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:59.910689 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-daaf7110-c8f7-4bb1-b481-d9c0899fc7c7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:08:59.911803 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-daaf7110-c8f7-4bb1-b481-d9c0899fc7c7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1405 microversion: 2.20 time: 0.289722 Feb 20 20:08:59.912439 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 332/681] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:08:59 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1405 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:09:00.047392 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-bc278b21-0c3b-4b95-8557-fb910e303aac tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:00.058094 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-bc278b21-0c3b-4b95-8557-fb910e303aac tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865" status: 200 len: 1318 microversion: 2.1 time: 0.232392 Feb 20 20:09:00.058944 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 350/682] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:08:59 2022] GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:00.636092 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-5a4ff8ee-4fa8-4f16-96b8-252cf8c50dbb req-4c0332c1-b0da-41de-9230-8908029f142a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f60f31-e3e4-4705-910a-d01bdba1d965", "name": "network-vif-plugged", "status": "completed", "tag": "1a899be1-fae4-4e55-ab37-e5b2c436daf0"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:09:00.637490 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:09:00.637490 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:09:00.648144 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-5a4ff8ee-4fa8-4f16-96b8-252cf8c50dbb req-4c0332c1-b0da-41de-9230-8908029f142a service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:00.649539 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-5a4ff8ee-4fa8-4f16-96b8-252cf8c50dbb req-4c0332c1-b0da-41de-9230-8908029f142a service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:00.669335 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-5a4ff8ee-4fa8-4f16-96b8-252cf8c50dbb req-4c0332c1-b0da-41de-9230-8908029f142a service nova] Creating event network-vif-plugged:1a899be1-fae4-4e55-ab37-e5b2c436daf0 for instance d2f60f31-e3e4-4705-910a-d01bdba1d965 on hv-cinder-83008 Feb 20 20:09:00.676755 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-5a4ff8ee-4fa8-4f16-96b8-252cf8c50dbb req-4c0332c1-b0da-41de-9230-8908029f142a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049726 Feb 20 20:09:00.678931 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 333/683] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:09:00.844347 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-24fcf08d-ee39-47fb-84a3-986b1ea725d5 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:00.844956 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-24fcf08d-ee39-47fb-84a3-986b1ea725d5 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:00.908423 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-24fcf08d-ee39-47fb-84a3-986b1ea725d5 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:00.916939 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-24fcf08d-ee39-47fb-84a3-986b1ea725d5 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 200 len: 1237 microversion: 2.1 time: 0.078096 Feb 20 20:09:00.926625 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 351/684] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:00 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:09:00.939679 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-859b7547-56f6-45a2-854c-92dd0a05c75c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:00.942130 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-859b7547-56f6-45a2-854c-92dd0a05c75c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:00.954094 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-859b7547-56f6-45a2-854c-92dd0a05c75c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:00.954821 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-859b7547-56f6-45a2-854c-92dd0a05c75c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:00.956097 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-859b7547-56f6-45a2-854c-92dd0a05c75c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:00.956791 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-859b7547-56f6-45a2-854c-92dd0a05c75c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:01.089531 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-22cc7950-f36a-443c-bc52-9d7905e28053 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:01.090486 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-22cc7950-f36a-443c-bc52-9d7905e28053 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:01.101147 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-22cc7950-f36a-443c-bc52-9d7905e28053 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:01.102138 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-22cc7950-f36a-443c-bc52-9d7905e28053 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:01.104499 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-22cc7950-f36a-443c-bc52-9d7905e28053 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:01.105412 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-22cc7950-f36a-443c-bc52-9d7905e28053 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:01.163940 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-859b7547-56f6-45a2-854c-92dd0a05c75c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:01.184389 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-859b7547-56f6-45a2-854c-92dd0a05c75c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:01.188996 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-859b7547-56f6-45a2-854c-92dd0a05c75c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:01.191501 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-859b7547-56f6-45a2-854c-92dd0a05c75c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1405 microversion: 2.20 time: 0.256518 Feb 20 20:09:01.193547 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 334/685] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:09:00 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1405 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:09:01.348808 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-22cc7950-f36a-443c-bc52-9d7905e28053 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:01.364641 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-22cc7950-f36a-443c-bc52-9d7905e28053 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865" status: 200 len: 1318 microversion: 2.1 time: 0.279799 Feb 20 20:09:01.365786 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 352/686] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:01 2022] GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:09:01.935072 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d92cb295-8e3a-49fd-8d13-d2665dca53cb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:01.935877 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d92cb295-8e3a-49fd-8d13-d2665dca53cb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:01.947223 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d92cb295-8e3a-49fd-8d13-d2665dca53cb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:01.948619 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d92cb295-8e3a-49fd-8d13-d2665dca53cb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:01.949984 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d92cb295-8e3a-49fd-8d13-d2665dca53cb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:01.950681 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d92cb295-8e3a-49fd-8d13-d2665dca53cb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:02.040101 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d92cb295-8e3a-49fd-8d13-d2665dca53cb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:02.052697 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d92cb295-8e3a-49fd-8d13-d2665dca53cb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 200 len: 1241 microversion: 2.1 time: 0.121973 Feb 20 20:09:02.053688 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 335/687] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:01 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 1241 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:02.295971 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8bc9deee-417f-4c1a-bf48-315e42901ae0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:02.297160 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8bc9deee-417f-4c1a-bf48-315e42901ae0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:02.307477 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8bc9deee-417f-4c1a-bf48-315e42901ae0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:02.308214 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8bc9deee-417f-4c1a-bf48-315e42901ae0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:02.309596 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8bc9deee-417f-4c1a-bf48-315e42901ae0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:02.310313 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8bc9deee-417f-4c1a-bf48-315e42901ae0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:02.393117 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9fa12c5b-c102-48ab-b86b-2c38f388fe06 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:02.394310 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9fa12c5b-c102-48ab-b86b-2c38f388fe06 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:02.406399 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9fa12c5b-c102-48ab-b86b-2c38f388fe06 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:02.407269 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9fa12c5b-c102-48ab-b86b-2c38f388fe06 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:02.408793 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9fa12c5b-c102-48ab-b86b-2c38f388fe06 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:02.409777 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9fa12c5b-c102-48ab-b86b-2c38f388fe06 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:02.550421 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8bc9deee-417f-4c1a-bf48-315e42901ae0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:02.565908 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8bc9deee-417f-4c1a-bf48-315e42901ae0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:02.568991 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8bc9deee-417f-4c1a-bf48-315e42901ae0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:02.571189 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8bc9deee-417f-4c1a-bf48-315e42901ae0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1405 microversion: 2.20 time: 0.359016 Feb 20 20:09:02.572746 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 353/688] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:09:02 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1405 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:09:02.672443 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-9fa12c5b-c102-48ab-b86b-2c38f388fe06 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:02.683979 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9fa12c5b-c102-48ab-b86b-2c38f388fe06 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865" status: 200 len: 1318 microversion: 2.1 time: 0.298745 Feb 20 20:09:02.684592 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 336/689] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:02 2022] GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865 => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:03.076348 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d0a63042-1e83-4c6a-96b2-0d1b782c9534 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:03.077490 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d0a63042-1e83-4c6a-96b2-0d1b782c9534 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:03.085876 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d0a63042-1e83-4c6a-96b2-0d1b782c9534 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:03.086500 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d0a63042-1e83-4c6a-96b2-0d1b782c9534 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:03.087563 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d0a63042-1e83-4c6a-96b2-0d1b782c9534 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:03.088821 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d0a63042-1e83-4c6a-96b2-0d1b782c9534 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:03.190148 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d0a63042-1e83-4c6a-96b2-0d1b782c9534 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:03.202872 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d0a63042-1e83-4c6a-96b2-0d1b782c9534 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 200 len: 1289 microversion: 2.1 time: 0.133298 Feb 20 20:09:03.204151 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 354/690] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:03 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 1289 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:03.605425 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a2ed71d4-7f54-420e-bc83-c4fc068637c5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:03.606533 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a2ed71d4-7f54-420e-bc83-c4fc068637c5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:03.618240 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a2ed71d4-7f54-420e-bc83-c4fc068637c5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:03.619045 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a2ed71d4-7f54-420e-bc83-c4fc068637c5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:03.621628 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a2ed71d4-7f54-420e-bc83-c4fc068637c5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:03.622392 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a2ed71d4-7f54-420e-bc83-c4fc068637c5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:03.706040 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-145e8455-13e7-4106-8560-738ba672c80a tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:03.708422 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-145e8455-13e7-4106-8560-738ba672c80a tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:03.725708 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-145e8455-13e7-4106-8560-738ba672c80a tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:03.725708 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-145e8455-13e7-4106-8560-738ba672c80a tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:03.725708 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-145e8455-13e7-4106-8560-738ba672c80a tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:03.725708 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-145e8455-13e7-4106-8560-738ba672c80a tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:03.875954 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a2ed71d4-7f54-420e-bc83-c4fc068637c5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:03.889257 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a2ed71d4-7f54-420e-bc83-c4fc068637c5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:03.890759 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a2ed71d4-7f54-420e-bc83-c4fc068637c5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:03.891968 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a2ed71d4-7f54-420e-bc83-c4fc068637c5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1598 microversion: 2.20 time: 0.294479 Feb 20 20:09:03.892531 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 337/691] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:09:03 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1598 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:09:03.914708 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8672d55b-4c19-432f-aca1-4aa20f9a20a6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:03.915209 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8672d55b-4c19-432f-aca1-4aa20f9a20a6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:03.927591 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8672d55b-4c19-432f-aca1-4aa20f9a20a6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:03.929203 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8672d55b-4c19-432f-aca1-4aa20f9a20a6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:03.930126 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8672d55b-4c19-432f-aca1-4aa20f9a20a6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:03.931977 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8672d55b-4c19-432f-aca1-4aa20f9a20a6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:03.999753 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-145e8455-13e7-4106-8560-738ba672c80a tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:04.002391 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-145e8455-13e7-4106-8560-738ba672c80a tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865" status: 200 len: 1318 microversion: 2.1 time: 0.303315 Feb 20 20:09:04.015237 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 355/692] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:03 2022] GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865 => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:04.074667 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8672d55b-4c19-432f-aca1-4aa20f9a20a6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.163620 Feb 20 20:09:04.075882 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 338/693] 10.222.0.60 () {60 vars in 1315 bytes} [Sun Feb 20 20:09:03 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965/os-interface => generated 285 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 20 20:09:04.234863 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-418e0777-38d2-4b4d-9106-c9f0ba4ce65e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:04.246165 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-418e0777-38d2-4b4d-9106-c9f0ba4ce65e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:04.255582 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-418e0777-38d2-4b4d-9106-c9f0ba4ce65e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:04.256193 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-418e0777-38d2-4b4d-9106-c9f0ba4ce65e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:04.257330 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-418e0777-38d2-4b4d-9106-c9f0ba4ce65e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:04.258049 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-418e0777-38d2-4b4d-9106-c9f0ba4ce65e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:04.378569 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-418e0777-38d2-4b4d-9106-c9f0ba4ce65e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:04.393108 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-418e0777-38d2-4b4d-9106-c9f0ba4ce65e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 200 len: 1295 microversion: 2.1 time: 0.165306 Feb 20 20:09:04.401207 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 356/694] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:04 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 1295 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:04.596469 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-31e147bc-bbd7-4793-83c4-80276cd154c2 req-cc4153b6-a323-4448-9c43-8aacfb4f3ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "663894bf-b677-40cf-8c2f-db3bc1531865", "name": "network-vif-plugged", "status": "completed", "tag": "04c29bfa-c7dd-4a87-8d83-65625078dd50"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:09:04.599975 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:09:04.599975 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:09:04.623759 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-31e147bc-bbd7-4793-83c4-80276cd154c2 req-cc4153b6-a323-4448-9c43-8aacfb4f3ea4 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:04.624573 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-31e147bc-bbd7-4793-83c4-80276cd154c2 req-cc4153b6-a323-4448-9c43-8aacfb4f3ea4 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:04.647226 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-31e147bc-bbd7-4793-83c4-80276cd154c2 req-cc4153b6-a323-4448-9c43-8aacfb4f3ea4 service nova] Creating event network-vif-plugged:04c29bfa-c7dd-4a87-8d83-65625078dd50 for instance 663894bf-b677-40cf-8c2f-db3bc1531865 on hv-cinder-83008 Feb 20 20:09:04.657898 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-31e147bc-bbd7-4793-83c4-80276cd154c2 req-cc4153b6-a323-4448-9c43-8aacfb4f3ea4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068946 Feb 20 20:09:04.660491 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 339/695] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:09:05.031338 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b73f318d-0168-498d-8bda-8a156b37ba03 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:05.032845 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b73f318d-0168-498d-8bda-8a156b37ba03 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:05.045039 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b73f318d-0168-498d-8bda-8a156b37ba03 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:05.046199 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b73f318d-0168-498d-8bda-8a156b37ba03 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:05.047888 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b73f318d-0168-498d-8bda-8a156b37ba03 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:05.048626 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b73f318d-0168-498d-8bda-8a156b37ba03 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:05.421641 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d5d2c0a3-4ebc-439e-b9e8-17310a673b35 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:05.422359 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d5d2c0a3-4ebc-439e-b9e8-17310a673b35 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:05.429332 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d5d2c0a3-4ebc-439e-b9e8-17310a673b35 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:05.430058 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d5d2c0a3-4ebc-439e-b9e8-17310a673b35 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:05.431115 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d5d2c0a3-4ebc-439e-b9e8-17310a673b35 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:05.432473 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d5d2c0a3-4ebc-439e-b9e8-17310a673b35 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:05.866540 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b73f318d-0168-498d-8bda-8a156b37ba03 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:05.892655 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b73f318d-0168-498d-8bda-8a156b37ba03 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865" status: 200 len: 1318 microversion: 2.1 time: 0.866657 Feb 20 20:09:05.895157 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 357/696] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:05 2022] GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865 => generated 1318 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:06.066415 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d5d2c0a3-4ebc-439e-b9e8-17310a673b35 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:06.081294 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d5d2c0a3-4ebc-439e-b9e8-17310a673b35 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 200 len: 1363 microversion: 2.1 time: 0.665397 Feb 20 20:09:06.083009 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 340/697] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:05 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 1363 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:06.310202 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-96317ccc-f6e8-4ae3-ba37-3d0b24254536 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:06.311014 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-95ec166f-f7aa-4998-88e1-37b4b64f2def req-e0334275-b2a7-4f12-8a8a-899299ef2c68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2f60f31-e3e4-4705-910a-d01bdba1d965", "tag": "1a899be1-fae4-4e55-ab37-e5b2c436daf0"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:09:06.312652 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-96317ccc-f6e8-4ae3-ba37-3d0b24254536 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:06.313491 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:09:06.313491 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:09:06.325389 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-96317ccc-f6e8-4ae3-ba37-3d0b24254536 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:06.326399 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-96317ccc-f6e8-4ae3-ba37-3d0b24254536 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:06.328162 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-95ec166f-f7aa-4998-88e1-37b4b64f2def req-e0334275-b2a7-4f12-8a8a-899299ef2c68 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:06.328434 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-96317ccc-f6e8-4ae3-ba37-3d0b24254536 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:06.329408 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-96317ccc-f6e8-4ae3-ba37-3d0b24254536 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:06.329744 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-95ec166f-f7aa-4998-88e1-37b4b64f2def req-e0334275-b2a7-4f12-8a8a-899299ef2c68 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:06.355259 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-95ec166f-f7aa-4998-88e1-37b4b64f2def req-e0334275-b2a7-4f12-8a8a-899299ef2c68 service nova] Creating event network-changed:1a899be1-fae4-4e55-ab37-e5b2c436daf0 for instance d2f60f31-e3e4-4705-910a-d01bdba1d965 on hv-cinder-83008 Feb 20 20:09:06.370427 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-96317ccc-f6e8-4ae3-ba37-3d0b24254536 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965/ips" status: 200 len: 113 microversion: 2.20 time: 0.069597 Feb 20 20:09:06.372347 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-95ec166f-f7aa-4998-88e1-37b4b64f2def req-e0334275-b2a7-4f12-8a8a-899299ef2c68 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068767 Feb 20 20:09:06.373339 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 341/698] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:09:06.373512 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 358/699] 10.222.0.60 () {60 vars in 1288 bytes} [Sun Feb 20 20:09:06 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965/ips => generated 113 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 20 20:09:06.386329 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-30d2274a-4284-4a20-89a1-a7d412353356 req-ddb0aed7-4460-4ae8-8eaa-fdbed6c93a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34811e5b-3079-49d9-8b1f-5e3284872e21", "tag": "2fc382f7-754d-4b58-ae91-4ee69bef1fc1"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:09:06.390943 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:09:06.390943 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:09:06.406261 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-30d2274a-4284-4a20-89a1-a7d412353356 req-ddb0aed7-4460-4ae8-8eaa-fdbed6c93a68 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:06.407622 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-30d2274a-4284-4a20-89a1-a7d412353356 req-ddb0aed7-4460-4ae8-8eaa-fdbed6c93a68 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:06.453196 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-30d2274a-4284-4a20-89a1-a7d412353356 req-ddb0aed7-4460-4ae8-8eaa-fdbed6c93a68 service nova] Creating event network-changed:2fc382f7-754d-4b58-ae91-4ee69bef1fc1 for instance 34811e5b-3079-49d9-8b1f-5e3284872e21 on hv-cinder-83008 Feb 20 20:09:06.464269 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-30d2274a-4284-4a20-89a1-a7d412353356 req-ddb0aed7-4460-4ae8-8eaa-fdbed6c93a68 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080814 Feb 20 20:09:06.467271 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 342/700] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:09:06.921812 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-740fa87b-74f7-4f8a-b351-d5b478a29fc2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:06.923028 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-740fa87b-74f7-4f8a-b351-d5b478a29fc2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:06.934228 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-740fa87b-74f7-4f8a-b351-d5b478a29fc2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:06.949996 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-740fa87b-74f7-4f8a-b351-d5b478a29fc2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:06.949996 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-740fa87b-74f7-4f8a-b351-d5b478a29fc2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:06.949996 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-740fa87b-74f7-4f8a-b351-d5b478a29fc2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:07.114443 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7d5c744e-c6c1-43a9-8ec1-c25381555c8b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:07.118418 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7d5c744e-c6c1-43a9-8ec1-c25381555c8b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:07.134455 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7d5c744e-c6c1-43a9-8ec1-c25381555c8b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:07.136020 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7d5c744e-c6c1-43a9-8ec1-c25381555c8b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:07.138141 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7d5c744e-c6c1-43a9-8ec1-c25381555c8b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:07.139510 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7d5c744e-c6c1-43a9-8ec1-c25381555c8b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:07.407253 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-740fa87b-74f7-4f8a-b351-d5b478a29fc2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:07.425485 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-740fa87b-74f7-4f8a-b351-d5b478a29fc2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865" status: 200 len: 1318 microversion: 2.1 time: 0.510466 Feb 20 20:09:07.427569 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 359/701] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:06 2022] GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865 => generated 1318 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:07.598049 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7d5c744e-c6c1-43a9-8ec1-c25381555c8b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:07.610735 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7d5c744e-c6c1-43a9-8ec1-c25381555c8b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 200 len: 1363 microversion: 2.1 time: 0.504110 Feb 20 20:09:07.611718 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 343/702] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:07 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 1363 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:08.460271 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b0e51e5c-7777-40fc-9d34-667b41e1c1d0 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:08.461407 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b0e51e5c-7777-40fc-9d34-667b41e1c1d0 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:08.472185 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b0e51e5c-7777-40fc-9d34-667b41e1c1d0 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:08.474932 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b0e51e5c-7777-40fc-9d34-667b41e1c1d0 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:08.474932 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b0e51e5c-7777-40fc-9d34-667b41e1c1d0 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:08.474932 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b0e51e5c-7777-40fc-9d34-667b41e1c1d0 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:08.643363 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-30a8484c-45e2-4114-b636-823585e46445 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:08.644636 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-30a8484c-45e2-4114-b636-823585e46445 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:08.659259 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-30a8484c-45e2-4114-b636-823585e46445 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:08.659259 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-30a8484c-45e2-4114-b636-823585e46445 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:08.659259 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-30a8484c-45e2-4114-b636-823585e46445 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:08.659259 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-30a8484c-45e2-4114-b636-823585e46445 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:08.678155 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b0e51e5c-7777-40fc-9d34-667b41e1c1d0 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:08.687434 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b0e51e5c-7777-40fc-9d34-667b41e1c1d0 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865" status: 200 len: 1509 microversion: 2.1 time: 0.234796 Feb 20 20:09:08.688150 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 360/703] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:08 2022] GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865 => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:08.878875 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-30a8484c-45e2-4114-b636-823585e46445 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:08.892413 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-30a8484c-45e2-4114-b636-823585e46445 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 200 len: 1363 microversion: 2.1 time: 0.256567 Feb 20 20:09:08.901738 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 344/704] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:08 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:09:09.912569 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-dc4b659b-ad53-421c-a9ab-19a764db05f2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:09.913259 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-dc4b659b-ad53-421c-a9ab-19a764db05f2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:09.922086 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dc4b659b-ad53-421c-a9ab-19a764db05f2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:09.922527 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dc4b659b-ad53-421c-a9ab-19a764db05f2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:09.923309 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dc4b659b-ad53-421c-a9ab-19a764db05f2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:09.923734 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dc4b659b-ad53-421c-a9ab-19a764db05f2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:10.084764 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-dc4b659b-ad53-421c-a9ab-19a764db05f2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:10.094917 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-dc4b659b-ad53-421c-a9ab-19a764db05f2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 200 len: 1363 microversion: 2.1 time: 0.185979 Feb 20 20:09:10.095504 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 361/705] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:09 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:10.646115 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1c353500-5a9c-4168-aa9a-2613b392726c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c2918d4-ae17-486b-84b0-6044ac135406"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:09:10.647285 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1c353500-5a9c-4168-aa9a-2613b392726c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:10.654364 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1c353500-5a9c-4168-aa9a-2613b392726c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:10.654837 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1c353500-5a9c-4168-aa9a-2613b392726c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:10.655721 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1c353500-5a9c-4168-aa9a-2613b392726c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:10.656222 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1c353500-5a9c-4168-aa9a-2613b392726c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:11.114006 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c0c3618f-6c3b-443a-a6e9-676fdc44a0a4 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:11.114832 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c0c3618f-6c3b-443a-a6e9-676fdc44a0a4 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:11.122471 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c0c3618f-6c3b-443a-a6e9-676fdc44a0a4 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:11.122976 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c0c3618f-6c3b-443a-a6e9-676fdc44a0a4 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:11.123989 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c0c3618f-6c3b-443a-a6e9-676fdc44a0a4 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:11.124522 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c0c3618f-6c3b-443a-a6e9-676fdc44a0a4 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:11.311031 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c0c3618f-6c3b-443a-a6e9-676fdc44a0a4 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:11.320185 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c0c3618f-6c3b-443a-a6e9-676fdc44a0a4 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 200 len: 1363 microversion: 2.1 time: 0.211114 Feb 20 20:09:11.320777 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 362/706] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:11 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:09:11.875264 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1c353500-5a9c-4168-aa9a-2613b392726c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "POST /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.232851 Feb 20 20:09:11.876282 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 345/707] 10.222.0.60 () {60 vars in 1322 bytes} [Sun Feb 20 20:09:10 2022] POST /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865/os-volume_attachments => generated 194 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:09:12.339242 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-050251e8-994d-47a2-ae30-e15a343c3cfe tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:12.339872 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-050251e8-994d-47a2-ae30-e15a343c3cfe tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:12.346699 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-050251e8-994d-47a2-ae30-e15a343c3cfe tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:12.347150 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-050251e8-994d-47a2-ae30-e15a343c3cfe tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:12.348066 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-050251e8-994d-47a2-ae30-e15a343c3cfe tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:12.348416 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-050251e8-994d-47a2-ae30-e15a343c3cfe tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:12.511226 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-050251e8-994d-47a2-ae30-e15a343c3cfe tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:12.520551 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-050251e8-994d-47a2-ae30-e15a343c3cfe tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 200 len: 1363 microversion: 2.1 time: 0.185141 Feb 20 20:09:12.521302 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 363/708] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:12 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:13.540371 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4922faa9-3723-4401-85d7-0471bd0a1ae6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:13.541694 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4922faa9-3723-4401-85d7-0471bd0a1ae6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:13.548780 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4922faa9-3723-4401-85d7-0471bd0a1ae6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:13.549342 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4922faa9-3723-4401-85d7-0471bd0a1ae6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:13.550132 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4922faa9-3723-4401-85d7-0471bd0a1ae6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:13.550561 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4922faa9-3723-4401-85d7-0471bd0a1ae6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:13.727024 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4922faa9-3723-4401-85d7-0471bd0a1ae6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:13.738180 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4922faa9-3723-4401-85d7-0471bd0a1ae6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 200 len: 1363 microversion: 2.1 time: 0.203395 Feb 20 20:09:13.738890 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 346/709] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:13 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:14.576129 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-98dc897e-d641-4402-befb-57fd5c226a7f req-49605212-0cd0-40df-accb-b7c1d04e20e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34811e5b-3079-49d9-8b1f-5e3284872e21", "name": "network-vif-plugged", "status": "completed", "tag": "2fc382f7-754d-4b58-ae91-4ee69bef1fc1"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:09:14.577914 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:09:14.577914 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:09:14.586278 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-98dc897e-d641-4402-befb-57fd5c226a7f req-49605212-0cd0-40df-accb-b7c1d04e20e9 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:14.586993 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-98dc897e-d641-4402-befb-57fd5c226a7f req-49605212-0cd0-40df-accb-b7c1d04e20e9 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:14.607064 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-98dc897e-d641-4402-befb-57fd5c226a7f req-49605212-0cd0-40df-accb-b7c1d04e20e9 service nova] Creating event network-vif-plugged:2fc382f7-754d-4b58-ae91-4ee69bef1fc1 for instance 34811e5b-3079-49d9-8b1f-5e3284872e21 on hv-cinder-83008 Feb 20 20:09:14.610338 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-98dc897e-d641-4402-befb-57fd5c226a7f req-49605212-0cd0-40df-accb-b7c1d04e20e9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038976 Feb 20 20:09:14.611082 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 364/710] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:09:14.759261 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-98c0e202-76ef-4b17-8e9a-6de095c8f896 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:14.760875 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-98c0e202-76ef-4b17-8e9a-6de095c8f896 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:14.767867 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-98c0e202-76ef-4b17-8e9a-6de095c8f896 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:14.768113 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-98c0e202-76ef-4b17-8e9a-6de095c8f896 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:14.769217 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-98c0e202-76ef-4b17-8e9a-6de095c8f896 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:14.769638 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-98c0e202-76ef-4b17-8e9a-6de095c8f896 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:14.971603 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-98c0e202-76ef-4b17-8e9a-6de095c8f896 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:14.982310 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-98c0e202-76ef-4b17-8e9a-6de095c8f896 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 200 len: 1363 microversion: 2.1 time: 0.226852 Feb 20 20:09:14.987814 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 347/711] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:14 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:16.007065 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7caf8e64-d4db-45d2-8f00-3888ecf9135b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:16.007880 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7caf8e64-d4db-45d2-8f00-3888ecf9135b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:16.021039 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7caf8e64-d4db-45d2-8f00-3888ecf9135b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:16.021511 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7caf8e64-d4db-45d2-8f00-3888ecf9135b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:16.022304 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7caf8e64-d4db-45d2-8f00-3888ecf9135b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:16.022730 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7caf8e64-d4db-45d2-8f00-3888ecf9135b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:16.184526 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7caf8e64-d4db-45d2-8f00-3888ecf9135b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:16.195563 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7caf8e64-d4db-45d2-8f00-3888ecf9135b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 200 len: 1363 microversion: 2.1 time: 0.196986 Feb 20 20:09:16.196328 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 365/712] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:15 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:17.215623 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-bc142778-edc6-4867-86db-5318d4cc8516 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:17.216271 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-bc142778-edc6-4867-86db-5318d4cc8516 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:17.224214 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bc142778-edc6-4867-86db-5318d4cc8516 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:17.224665 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bc142778-edc6-4867-86db-5318d4cc8516 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:17.225499 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bc142778-edc6-4867-86db-5318d4cc8516 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:17.225935 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bc142778-edc6-4867-86db-5318d4cc8516 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:17.406740 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-bc142778-edc6-4867-86db-5318d4cc8516 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:17.416712 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-bc142778-edc6-4867-86db-5318d4cc8516 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 200 len: 1363 microversion: 2.1 time: 0.204916 Feb 20 20:09:17.417734 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 348/713] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:17 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:18.435220 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5bad1359-3f0b-4c37-b084-74b069f9ac70 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:18.437566 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5bad1359-3f0b-4c37-b084-74b069f9ac70 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:18.442637 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5bad1359-3f0b-4c37-b084-74b069f9ac70 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:18.443387 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5bad1359-3f0b-4c37-b084-74b069f9ac70 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:18.444754 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5bad1359-3f0b-4c37-b084-74b069f9ac70 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:18.445521 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5bad1359-3f0b-4c37-b084-74b069f9ac70 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:18.632840 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5bad1359-3f0b-4c37-b084-74b069f9ac70 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:18.641953 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5bad1359-3f0b-4c37-b084-74b069f9ac70 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 200 len: 1548 microversion: 2.1 time: 0.210866 Feb 20 20:09:18.642547 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 366/714] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:18 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 1548 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:18.658997 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-fab9fd2b-5ae0-4cff-a5ba-c664066c3fef tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:18.659645 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-fab9fd2b-5ae0-4cff-a5ba-c664066c3fef tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:18.666599 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fab9fd2b-5ae0-4cff-a5ba-c664066c3fef tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:18.667051 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fab9fd2b-5ae0-4cff-a5ba-c664066c3fef tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:18.667836 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fab9fd2b-5ae0-4cff-a5ba-c664066c3fef tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:18.668276 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fab9fd2b-5ae0-4cff-a5ba-c664066c3fef tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:18.770072 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-fab9fd2b-5ae0-4cff-a5ba-c664066c3fef tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114689 Feb 20 20:09:18.770710 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 349/715] 10.222.0.60 () {58 vars in 1274 bytes} [Sun Feb 20 20:09:18 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:09:20.087238 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-405fb732-d5bb-4a13-b6a1-1bf9fdb6a13a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:20.088963 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-405fb732-d5bb-4a13-b6a1-1bf9fdb6a13a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:20.096180 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-405fb732-d5bb-4a13-b6a1-1bf9fdb6a13a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:20.096792 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-405fb732-d5bb-4a13-b6a1-1bf9fdb6a13a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:20.097605 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-405fb732-d5bb-4a13-b6a1-1bf9fdb6a13a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:20.098035 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-405fb732-d5bb-4a13-b6a1-1bf9fdb6a13a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:20.129416 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-405fb732-d5bb-4a13-b6a1-1bf9fdb6a13a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/ips" status: 200 len: 105 microversion: 2.1 time: 0.048917 Feb 20 20:09:20.137556 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 367/716] 10.222.0.60 () {58 vars in 1247 bytes} [Sun Feb 20 20:09:20 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/ips => generated 105 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:09:20.166965 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-a590d40c-988f-4583-8125-7d3a36cda588 req-3c5035ef-9b04-41ef-8369-382e6c3a4c2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34811e5b-3079-49d9-8b1f-5e3284872e21", "tag": "2fc382f7-754d-4b58-ae91-4ee69bef1fc1"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:09:20.169323 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:09:20.169323 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:09:20.176749 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-a590d40c-988f-4583-8125-7d3a36cda588 req-3c5035ef-9b04-41ef-8369-382e6c3a4c2b service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:20.177325 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-a590d40c-988f-4583-8125-7d3a36cda588 req-3c5035ef-9b04-41ef-8369-382e6c3a4c2b service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:20.189336 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-a590d40c-988f-4583-8125-7d3a36cda588 req-3c5035ef-9b04-41ef-8369-382e6c3a4c2b service nova] Creating event network-changed:2fc382f7-754d-4b58-ae91-4ee69bef1fc1 for instance 34811e5b-3079-49d9-8b1f-5e3284872e21 on hv-cinder-83008 Feb 20 20:09:20.197973 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-a590d40c-988f-4583-8125-7d3a36cda588 req-3c5035ef-9b04-41ef-8369-382e6c3a4c2b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113255 Feb 20 20:09:20.199101 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 350/717] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:09:21.029451 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-71a129a1-a6f6-40c3-8bbe-e79d91055cb2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c2918d4-ae17-486b-84b0-6044ac135406"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:09:21.033575 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-71a129a1-a6f6-40c3-8bbe-e79d91055cb2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:21.046330 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-71a129a1-a6f6-40c3-8bbe-e79d91055cb2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:21.049053 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-71a129a1-a6f6-40c3-8bbe-e79d91055cb2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:21.051200 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-71a129a1-a6f6-40c3-8bbe-e79d91055cb2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:21.051948 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-71a129a1-a6f6-40c3-8bbe-e79d91055cb2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:21.174769 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-71a129a1-a6f6-40c3-8bbe-e79d91055cb2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] HTTP exception thrown: Invalid volume: volume 9c2918d4-ae17-486b-84b0-6044ac135406 is already attached to instances: 663894bf-b677-40cf-8c2f-db3bc1531865 Feb 20 20:09:21.175960 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-71a129a1-a6f6-40c3-8bbe-e79d91055cb2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Returning 400 to user: Invalid volume: volume 9c2918d4-ae17-486b-84b0-6044ac135406 is already attached to instances: 663894bf-b677-40cf-8c2f-db3bc1531865 {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:09:21.177352 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-71a129a1-a6f6-40c3-8bbe-e79d91055cb2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "POST /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.154382 Feb 20 20:09:21.178396 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 368/718] 10.222.0.60 () {60 vars in 1322 bytes} [Sun Feb 20 20:09:21 2022] POST /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865/os-volume_attachments => generated 174 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 20 20:09:21.299950 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2dd49253-e203-4e9e-8ed8-7f291c1feca1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:21.300868 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2dd49253-e203-4e9e-8ed8-7f291c1feca1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:21.313383 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2dd49253-e203-4e9e-8ed8-7f291c1feca1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:21.314382 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2dd49253-e203-4e9e-8ed8-7f291c1feca1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:21.316040 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2dd49253-e203-4e9e-8ed8-7f291c1feca1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:21.317208 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2dd49253-e203-4e9e-8ed8-7f291c1feca1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:21.444675 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-2dd49253-e203-4e9e-8ed8-7f291c1feca1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lazy-loading 'services' on Instance uuid 663894bf-b677-40cf-8c2f-db3bc1531865 {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:09:21.910798 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2dd49253-e203-4e9e-8ed8-7f291c1feca1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "DELETE /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865/os-volume_attachments/9c2918d4-ae17-486b-84b0-6044ac135406" status: 202 len: 0 microversion: 2.1 time: 0.617003 Feb 20 20:09:21.911124 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 351/719] 10.222.0.60 () {58 vars in 1415 bytes} [Sun Feb 20 20:09:21 2022] DELETE /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865/os-volume_attachments/9c2918d4-ae17-486b-84b0-6044ac135406 => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:09:21.922669 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-169d7183-4dbc-4454-afd9-9f117b4d7b57 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:21.924230 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-169d7183-4dbc-4454-afd9-9f117b4d7b57 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:21.932468 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-169d7183-4dbc-4454-afd9-9f117b4d7b57 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:21.933460 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-169d7183-4dbc-4454-afd9-9f117b4d7b57 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:21.934544 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-169d7183-4dbc-4454-afd9-9f117b4d7b57 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:21.934986 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-169d7183-4dbc-4454-afd9-9f117b4d7b57 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:21.979467 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-169d7183-4dbc-4454-afd9-9f117b4d7b57 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061139 Feb 20 20:09:21.980485 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 369/720] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:09:21 2022] GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:09:22.994058 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c1a4bb52-7411-4434-98f7-35124a5622d4 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:22.995243 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c1a4bb52-7411-4434-98f7-35124a5622d4 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:23.002328 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c1a4bb52-7411-4434-98f7-35124a5622d4 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:23.002925 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c1a4bb52-7411-4434-98f7-35124a5622d4 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:23.003652 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c1a4bb52-7411-4434-98f7-35124a5622d4 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:23.004122 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c1a4bb52-7411-4434-98f7-35124a5622d4 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:23.036051 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c1a4bb52-7411-4434-98f7-35124a5622d4 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047643 Feb 20 20:09:23.036634 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 352/721] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:09:22 2022] GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:09:23.442237 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-063449cb-a672-417f-af79-02aa689b8d83 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db86aa63-dc50-429d-b628-fcd766b91c83"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:09:23.446031 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-063449cb-a672-417f-af79-02aa689b8d83 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:23.451667 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-063449cb-a672-417f-af79-02aa689b8d83 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:23.452114 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-063449cb-a672-417f-af79-02aa689b8d83 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:23.452950 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-063449cb-a672-417f-af79-02aa689b8d83 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:23.453573 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-063449cb-a672-417f-af79-02aa689b8d83 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:24.048121 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-173f8dd5-69d4-4ab1-bf57-b70c7d88d406 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:24.049303 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-173f8dd5-69d4-4ab1-bf57-b70c7d88d406 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:24.056124 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-173f8dd5-69d4-4ab1-bf57-b70c7d88d406 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:24.056567 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-173f8dd5-69d4-4ab1-bf57-b70c7d88d406 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:24.057503 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-173f8dd5-69d4-4ab1-bf57-b70c7d88d406 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:24.057951 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-173f8dd5-69d4-4ab1-bf57-b70c7d88d406 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:24.091738 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-173f8dd5-69d4-4ab1-bf57-b70c7d88d406 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047190 Feb 20 20:09:24.092520 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 353/722] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:09:24 2022] GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 20 20:09:24.203480 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1cc4ada2-6009-4816-b18c-e3111a578473 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-833361588", "imageRef": "61c0cc70-53e3-40ed-b353-ec1b5fc4eea4", "flavorRef": "452", "networks": [{"uuid": "8b2a19f4-c94f-444f-9511-f39cc6853442"}]}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:09:24.269728 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.network.neutron [None req-1cc4ada2-6009-4816-b18c-e3111a578473 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] validate_networks() for [('8b2a19f4-c94f-444f-9511-f39cc6853442', None, None, None, None, None)] {{(pid=117087) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 20 20:09:24.513276 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-063449cb-a672-417f-af79-02aa689b8d83 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "POST /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.074461 Feb 20 20:09:24.518961 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 370/723] 10.222.0.60 () {60 vars in 1322 bytes} [Sun Feb 20 20:09:23 2022] POST /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/os-volume_attachments => generated 194 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:09:24.795501 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-1cc4ada2-6009-4816-b18c-e3111a578473 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Flavor limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 20 20:09:24.795920 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-1cc4ada2-6009-4816-b18c-e3111a578473 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Image limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 20 20:09:24.796397 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-1cc4ada2-6009-4816-b18c-e3111a578473 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Flavor pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 20 20:09:24.796805 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-1cc4ada2-6009-4816-b18c-e3111a578473 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Image pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 20 20:09:24.797257 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-1cc4ada2-6009-4816-b18c-e3111a578473 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 20 20:09:24.811248 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1cc4ada2-6009-4816-b18c-e3111a578473 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:24.811691 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1cc4ada2-6009-4816-b18c-e3111a578473 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:24.812507 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1cc4ada2-6009-4816-b18c-e3111a578473 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:24.812954 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1cc4ada2-6009-4816-b18c-e3111a578473 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:24.832818 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-1cc4ada2-6009-4816-b18c-e3111a578473 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Getting quotas for project 79884d2db8f34ea3a56bb24700c0834b. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:09:24.840421 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-1cc4ada2-6009-4816-b18c-e3111a578473 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Getting quotas for user 3c74b25bf2e94447ab74a7e157eadac7 and project 79884d2db8f34ea3a56bb24700c0834b. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:09:24.856025 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1cc4ada2-6009-4816-b18c-e3111a578473 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Going to run 1 instances... {{(pid=117087) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 20 20:09:24.858567 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1cc4ada2-6009-4816-b18c-e3111a578473 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61c0cc70-53e3-40ed-b353-ec1b5fc4eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 20 20:09:25.060527 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1cc4ada2-6009-4816-b18c-e3111a578473 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.860837 Feb 20 20:09:25.061335 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 354/724] 10.222.0.60 () {60 vars in 1146 bytes} [Sun Feb 20 20:09:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 20 20:09:25.073022 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4f7b3d35-4024-467c-bb60-caaa3507c6c7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:25.074080 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4f7b3d35-4024-467c-bb60-caaa3507c6c7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:25.139928 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4f7b3d35-4024-467c-bb60-caaa3507c6c7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:25.147120 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4f7b3d35-4024-467c-bb60-caaa3507c6c7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2" status: 200 len: 1217 microversion: 2.1 time: 0.079101 Feb 20 20:09:25.147879 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 371/725] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:25 2022] GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:26.170565 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e0af7e4d-8742-4462-8e81-e7215ac9f193 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:26.171541 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e0af7e4d-8742-4462-8e81-e7215ac9f193 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:26.234565 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e0af7e4d-8742-4462-8e81-e7215ac9f193 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:26.242148 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e0af7e4d-8742-4462-8e81-e7215ac9f193 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2" status: 200 len: 1217 microversion: 2.1 time: 0.078589 Feb 20 20:09:26.242731 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 355/726] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:26 2022] GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2 => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:27.263076 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f48a9d9b-d7e4-48f6-9976-4bb4cd451ff7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:27.263886 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f48a9d9b-d7e4-48f6-9976-4bb4cd451ff7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:27.272210 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f48a9d9b-d7e4-48f6-9976-4bb4cd451ff7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:27.273381 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f48a9d9b-d7e4-48f6-9976-4bb4cd451ff7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:27.273503 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f48a9d9b-d7e4-48f6-9976-4bb4cd451ff7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:27.273877 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f48a9d9b-d7e4-48f6-9976-4bb4cd451ff7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:27.341536 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f48a9d9b-d7e4-48f6-9976-4bb4cd451ff7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:27.349301 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f48a9d9b-d7e4-48f6-9976-4bb4cd451ff7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2" status: 200 len: 1269 microversion: 2.1 time: 0.090645 Feb 20 20:09:27.349868 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 372/727] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:27 2022] GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2 => generated 1269 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:28.366499 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ce9208a8-6a09-4c00-bf7e-2450209cc40e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:28.367111 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ce9208a8-6a09-4c00-bf7e-2450209cc40e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:28.376154 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ce9208a8-6a09-4c00-bf7e-2450209cc40e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:28.376599 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ce9208a8-6a09-4c00-bf7e-2450209cc40e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:28.377423 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ce9208a8-6a09-4c00-bf7e-2450209cc40e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:28.377855 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ce9208a8-6a09-4c00-bf7e-2450209cc40e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:28.456034 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ce9208a8-6a09-4c00-bf7e-2450209cc40e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:28.463778 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ce9208a8-6a09-4c00-bf7e-2450209cc40e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2" status: 200 len: 1277 microversion: 2.1 time: 0.100876 Feb 20 20:09:28.464371 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 356/728] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:28 2022] GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2 => generated 1277 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:29.490672 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0f6d86d0-861b-49f7-a920-0d9d8a827723 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:29.492852 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-0f6d86d0-861b-49f7-a920-0d9d8a827723 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:29.502767 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0f6d86d0-861b-49f7-a920-0d9d8a827723 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:29.503214 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0f6d86d0-861b-49f7-a920-0d9d8a827723 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:29.504742 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0f6d86d0-861b-49f7-a920-0d9d8a827723 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:29.506122 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0f6d86d0-861b-49f7-a920-0d9d8a827723 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:29.746197 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0f6d86d0-861b-49f7-a920-0d9d8a827723 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:29.754586 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-0f6d86d0-861b-49f7-a920-0d9d8a827723 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2" status: 200 len: 1317 microversion: 2.1 time: 0.270405 Feb 20 20:09:29.755231 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 373/729] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:29 2022] GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2 => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:30.200588 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-5a9ff782-6b79-4725-8da6-de0a18b71cad req-9da55197-0300-4ffd-9878-de9c1ab39e09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6937382-84fd-4e0f-9efc-06044526bba2", "tag": "aa6313ae-aae7-4bf6-95d3-33dafde145dd"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:09:30.202968 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:09:30.202968 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:09:30.211906 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-5a9ff782-6b79-4725-8da6-de0a18b71cad req-9da55197-0300-4ffd-9878-de9c1ab39e09 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:30.212347 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-5a9ff782-6b79-4725-8da6-de0a18b71cad req-9da55197-0300-4ffd-9878-de9c1ab39e09 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:30.230728 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-5a9ff782-6b79-4725-8da6-de0a18b71cad req-9da55197-0300-4ffd-9878-de9c1ab39e09 service nova] Creating event network-changed:aa6313ae-aae7-4bf6-95d3-33dafde145dd for instance d6937382-84fd-4e0f-9efc-06044526bba2 on hv-cinder-83008 Feb 20 20:09:30.237391 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-5a9ff782-6b79-4725-8da6-de0a18b71cad req-9da55197-0300-4ffd-9878-de9c1ab39e09 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040786 Feb 20 20:09:30.238192 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 357/730] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:09:30.776797 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-48b43785-f06d-40c1-a94d-2a23de4ddcc5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:30.778066 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-48b43785-f06d-40c1-a94d-2a23de4ddcc5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:30.784882 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-48b43785-f06d-40c1-a94d-2a23de4ddcc5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:30.785362 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-48b43785-f06d-40c1-a94d-2a23de4ddcc5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:30.786158 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-48b43785-f06d-40c1-a94d-2a23de4ddcc5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:30.786596 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-48b43785-f06d-40c1-a94d-2a23de4ddcc5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:30.894545 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-dce156dd-8364-40d0-b6f2-f2eb672e9b3e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:09:30.895627 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-dce156dd-8364-40d0-b6f2-f2eb672e9b3e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:30.905774 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dce156dd-8364-40d0-b6f2-f2eb672e9b3e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:30.906232 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dce156dd-8364-40d0-b6f2-f2eb672e9b3e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:30.907806 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dce156dd-8364-40d0-b6f2-f2eb672e9b3e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:30.908320 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dce156dd-8364-40d0-b6f2-f2eb672e9b3e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:30.944836 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-dce156dd-8364-40d0-b6f2-f2eb672e9b3e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lazy-loading 'flavor' on Instance uuid e19d0359-a8b7-4b10-9423-86e7bc401f0b {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:09:31.095536 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-48b43785-f06d-40c1-a94d-2a23de4ddcc5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:31.106579 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-48b43785-f06d-40c1-a94d-2a23de4ddcc5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2" status: 200 len: 1317 microversion: 2.1 time: 0.335869 Feb 20 20:09:31.107332 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 374/731] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:30 2022] GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2 => generated 1317 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:31.398995 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-dce156dd-8364-40d0-b6f2-f2eb672e9b3e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "POST /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b/action" status: 202 len: 0 microversion: 2.1 time: 0.509307 Feb 20 20:09:31.399596 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 358/732] 10.222.0.60 () {60 vars in 1277 bytes} [Sun Feb 20 20:09:30 2022] POST /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 20 20:09:31.409317 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-00b1755d-40f5-4740-9d6b-237ae0328e2e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:31.409921 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-00b1755d-40f5-4740-9d6b-237ae0328e2e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:31.415979 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-00b1755d-40f5-4740-9d6b-237ae0328e2e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:31.416427 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-00b1755d-40f5-4740-9d6b-237ae0328e2e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:31.417392 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-00b1755d-40f5-4740-9d6b-237ae0328e2e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:31.417820 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-00b1755d-40f5-4740-9d6b-237ae0328e2e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:31.570243 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-00b1755d-40f5-4740-9d6b-237ae0328e2e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:31.578183 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-00b1755d-40f5-4740-9d6b-237ae0328e2e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1569 microversion: 2.1 time: 0.172603 Feb 20 20:09:31.578760 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 375/733] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:31 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:32.131747 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3ff71283-5766-42a1-8fc8-6dbb4dcfcee6 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:32.131747 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3ff71283-5766-42a1-8fc8-6dbb4dcfcee6 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:32.139107 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3ff71283-5766-42a1-8fc8-6dbb4dcfcee6 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:32.141401 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3ff71283-5766-42a1-8fc8-6dbb4dcfcee6 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:32.141401 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3ff71283-5766-42a1-8fc8-6dbb4dcfcee6 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:32.141401 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3ff71283-5766-42a1-8fc8-6dbb4dcfcee6 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:32.303232 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3ff71283-5766-42a1-8fc8-6dbb4dcfcee6 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:32.312115 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3ff71283-5766-42a1-8fc8-6dbb4dcfcee6 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2" status: 200 len: 1317 microversion: 2.1 time: 0.187312 Feb 20 20:09:32.313487 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 359/734] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:32 2022] GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:32.596311 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-83212560-7143-4a29-b240-e093f861623e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:32.597138 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-83212560-7143-4a29-b240-e093f861623e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:32.603363 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-83212560-7143-4a29-b240-e093f861623e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:32.604183 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-83212560-7143-4a29-b240-e093f861623e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:32.604955 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-83212560-7143-4a29-b240-e093f861623e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:32.605452 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-83212560-7143-4a29-b240-e093f861623e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:32.771143 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-83212560-7143-4a29-b240-e093f861623e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:32.784195 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-83212560-7143-4a29-b240-e093f861623e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1569 microversion: 2.1 time: 0.191634 Feb 20 20:09:32.785316 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 376/735] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:32 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:33.331436 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4e72809c-9c17-40c4-a4b7-b182ddeee2e2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:33.332783 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4e72809c-9c17-40c4-a4b7-b182ddeee2e2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:33.340224 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4e72809c-9c17-40c4-a4b7-b182ddeee2e2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:33.340677 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4e72809c-9c17-40c4-a4b7-b182ddeee2e2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:33.341538 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4e72809c-9c17-40c4-a4b7-b182ddeee2e2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:33.341967 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4e72809c-9c17-40c4-a4b7-b182ddeee2e2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:33.504643 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4e72809c-9c17-40c4-a4b7-b182ddeee2e2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:33.516982 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4e72809c-9c17-40c4-a4b7-b182ddeee2e2 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2" status: 200 len: 1317 microversion: 2.1 time: 0.190093 Feb 20 20:09:33.517994 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 360/736] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:33 2022] GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2 => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:33.801993 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-789daaf3-a167-446f-af10-da62840a8e56 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:33.802576 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-789daaf3-a167-446f-af10-da62840a8e56 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:33.810033 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-789daaf3-a167-446f-af10-da62840a8e56 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:33.810471 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-789daaf3-a167-446f-af10-da62840a8e56 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:33.811254 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-789daaf3-a167-446f-af10-da62840a8e56 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:33.811688 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-789daaf3-a167-446f-af10-da62840a8e56 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:33.962295 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-789daaf3-a167-446f-af10-da62840a8e56 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:33.971346 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-789daaf3-a167-446f-af10-da62840a8e56 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1569 microversion: 2.1 time: 0.173057 Feb 20 20:09:33.971933 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 377/737] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:33 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:34.183565 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e1b7ae12-4102-4937-b141-6966bebcf4c3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:34.184470 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e1b7ae12-4102-4937-b141-6966bebcf4c3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:34.190580 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e1b7ae12-4102-4937-b141-6966bebcf4c3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:34.191022 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e1b7ae12-4102-4937-b141-6966bebcf4c3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:34.191810 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e1b7ae12-4102-4937-b141-6966bebcf4c3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:34.192246 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e1b7ae12-4102-4937-b141-6966bebcf4c3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:34.226534 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e1b7ae12-4102-4937-b141-6966bebcf4c3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047854 Feb 20 20:09:34.227129 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 361/738] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:09:34 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:09:34.237606 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d64f4fbb-4c86-406c-a362-e5e5667b7b61 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:34.238094 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d64f4fbb-4c86-406c-a362-e5e5667b7b61 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:34.244907 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d64f4fbb-4c86-406c-a362-e5e5667b7b61 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:34.245385 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d64f4fbb-4c86-406c-a362-e5e5667b7b61 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:34.246174 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d64f4fbb-4c86-406c-a362-e5e5667b7b61 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:34.246612 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d64f4fbb-4c86-406c-a362-e5e5667b7b61 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:34.279350 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d64f4fbb-4c86-406c-a362-e5e5667b7b61 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/os-volume_attachments/db86aa63-dc50-429d-b628-fcd766b91c83" status: 200 len: 194 microversion: 2.1 time: 0.045750 Feb 20 20:09:34.279952 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 378/739] 10.222.0.60 () {58 vars in 1412 bytes} [Sun Feb 20 20:09:34 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/os-volume_attachments/db86aa63-dc50-429d-b628-fcd766b91c83 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:09:34.535704 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-334a80ab-43cf-435e-a278-c0d7db14a7e7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:34.536434 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-334a80ab-43cf-435e-a278-c0d7db14a7e7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:34.543763 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-334a80ab-43cf-435e-a278-c0d7db14a7e7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:34.544196 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-334a80ab-43cf-435e-a278-c0d7db14a7e7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:34.544987 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-334a80ab-43cf-435e-a278-c0d7db14a7e7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:34.545441 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-334a80ab-43cf-435e-a278-c0d7db14a7e7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:34.698708 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-334a80ab-43cf-435e-a278-c0d7db14a7e7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:34.711370 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-334a80ab-43cf-435e-a278-c0d7db14a7e7 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2" status: 200 len: 1317 microversion: 2.1 time: 0.178956 Feb 20 20:09:34.712240 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 362/740] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:34 2022] GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:34.990045 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ce13a742-92fe-4aa6-a121-1cbc40659c2e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:34.990834 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ce13a742-92fe-4aa6-a121-1cbc40659c2e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:34.998625 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ce13a742-92fe-4aa6-a121-1cbc40659c2e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:34.999208 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ce13a742-92fe-4aa6-a121-1cbc40659c2e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:34.999988 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ce13a742-92fe-4aa6-a121-1cbc40659c2e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:35.000417 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ce13a742-92fe-4aa6-a121-1cbc40659c2e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:35.152819 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ce13a742-92fe-4aa6-a121-1cbc40659c2e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:35.160912 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ce13a742-92fe-4aa6-a121-1cbc40659c2e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1569 microversion: 2.1 time: 0.175162 Feb 20 20:09:35.161600 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 379/741] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:34 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:35.740560 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e3e1e1cc-e655-43de-9ef3-e5bbd96c364e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:35.741266 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e3e1e1cc-e655-43de-9ef3-e5bbd96c364e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:35.748486 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e3e1e1cc-e655-43de-9ef3-e5bbd96c364e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:35.748929 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e3e1e1cc-e655-43de-9ef3-e5bbd96c364e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:35.749777 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e3e1e1cc-e655-43de-9ef3-e5bbd96c364e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:35.750212 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e3e1e1cc-e655-43de-9ef3-e5bbd96c364e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:35.898399 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e3e1e1cc-e655-43de-9ef3-e5bbd96c364e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:35.907907 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e3e1e1cc-e655-43de-9ef3-e5bbd96c364e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2" status: 200 len: 1317 microversion: 2.1 time: 0.170934 Feb 20 20:09:35.908499 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 363/742] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:35 2022] GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:36.002641 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-aced88a3-6c90-4652-85e7-b211ec4391e7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2260f38-7187-4340-aa46-a66299f1d28d"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:09:36.003711 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-aced88a3-6c90-4652-85e7-b211ec4391e7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:36.011845 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aced88a3-6c90-4652-85e7-b211ec4391e7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:36.012300 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aced88a3-6c90-4652-85e7-b211ec4391e7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:36.013161 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aced88a3-6c90-4652-85e7-b211ec4391e7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:36.013795 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aced88a3-6c90-4652-85e7-b211ec4391e7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:36.181285 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-54fb9419-3816-4441-bbcc-14db07d41b7f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:36.183005 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-54fb9419-3816-4441-bbcc-14db07d41b7f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:36.192888 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-54fb9419-3816-4441-bbcc-14db07d41b7f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:36.193593 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-54fb9419-3816-4441-bbcc-14db07d41b7f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:36.194396 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-54fb9419-3816-4441-bbcc-14db07d41b7f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:36.194827 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-54fb9419-3816-4441-bbcc-14db07d41b7f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:36.386070 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-54fb9419-3816-4441-bbcc-14db07d41b7f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:36.396247 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-54fb9419-3816-4441-bbcc-14db07d41b7f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1569 microversion: 2.1 time: 0.221049 Feb 20 20:09:36.396852 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 364/743] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:36 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:37.003663 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-cf080a08-24cd-48aa-9050-630f3675af42 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:37.003663 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-cf080a08-24cd-48aa-9050-630f3675af42 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:37.003663 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cf080a08-24cd-48aa-9050-630f3675af42 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:37.003663 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cf080a08-24cd-48aa-9050-630f3675af42 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:37.005224 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cf080a08-24cd-48aa-9050-630f3675af42 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:37.005224 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-cf080a08-24cd-48aa-9050-630f3675af42 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:37.077924 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-cf080a08-24cd-48aa-9050-630f3675af42 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:37.085429 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-cf080a08-24cd-48aa-9050-630f3675af42 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2" status: 200 len: 1317 microversion: 2.1 time: 0.163681 Feb 20 20:09:37.091244 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 365/744] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:36 2022] GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:37.118757 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-aced88a3-6c90-4652-85e7-b211ec4391e7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "POST /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.121328 Feb 20 20:09:37.119470 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 380/745] 10.222.0.60 () {60 vars in 1322 bytes} [Sun Feb 20 20:09:35 2022] POST /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/os-volume_attachments => generated 194 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:09:37.417998 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b43cdb09-78c0-4d19-abd8-dd31347f1ed4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:37.419235 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b43cdb09-78c0-4d19-abd8-dd31347f1ed4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:37.430484 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b43cdb09-78c0-4d19-abd8-dd31347f1ed4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:37.431296 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b43cdb09-78c0-4d19-abd8-dd31347f1ed4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:37.433279 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b43cdb09-78c0-4d19-abd8-dd31347f1ed4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:37.434074 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b43cdb09-78c0-4d19-abd8-dd31347f1ed4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:37.599351 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b43cdb09-78c0-4d19-abd8-dd31347f1ed4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:37.610032 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b43cdb09-78c0-4d19-abd8-dd31347f1ed4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1569 microversion: 2.1 time: 0.198812 Feb 20 20:09:37.610636 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 366/746] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:37 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:38.105014 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0ff5528a-8494-4082-86a6-8015549d90ff tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:38.105657 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-0ff5528a-8494-4082-86a6-8015549d90ff tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:38.114704 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0ff5528a-8494-4082-86a6-8015549d90ff tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:38.115140 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0ff5528a-8494-4082-86a6-8015549d90ff tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:38.115932 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0ff5528a-8494-4082-86a6-8015549d90ff tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:38.116362 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0ff5528a-8494-4082-86a6-8015549d90ff tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:38.284345 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0ff5528a-8494-4082-86a6-8015549d90ff tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:38.296009 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-0ff5528a-8494-4082-86a6-8015549d90ff tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2" status: 200 len: 1317 microversion: 2.1 time: 0.195905 Feb 20 20:09:38.319742 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 381/747] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:38 2022] GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:38.627606 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1ff3d9b9-2303-4655-8c9f-15e1c15250ba tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:38.628224 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1ff3d9b9-2303-4655-8c9f-15e1c15250ba tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:38.634652 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1ff3d9b9-2303-4655-8c9f-15e1c15250ba tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:38.635100 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1ff3d9b9-2303-4655-8c9f-15e1c15250ba tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:38.635876 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1ff3d9b9-2303-4655-8c9f-15e1c15250ba tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:38.636804 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1ff3d9b9-2303-4655-8c9f-15e1c15250ba tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:38.804836 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1ff3d9b9-2303-4655-8c9f-15e1c15250ba tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:38.817914 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-d53fbd62-a9fa-43a7-b94a-1e026cc9d7af req-f3beeef2-731e-450c-9a0a-1ce5729eb938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6937382-84fd-4e0f-9efc-06044526bba2", "name": "network-vif-plugged", "status": "completed", "tag": "aa6313ae-aae7-4bf6-95d3-33dafde145dd"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:09:38.818781 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1ff3d9b9-2303-4655-8c9f-15e1c15250ba tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1569 microversion: 2.1 time: 0.194488 Feb 20 20:09:38.819611 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 367/748] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:38 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:38.820151 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:09:38.820151 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:09:38.830391 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-d53fbd62-a9fa-43a7-b94a-1e026cc9d7af req-f3beeef2-731e-450c-9a0a-1ce5729eb938 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:38.831001 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-d53fbd62-a9fa-43a7-b94a-1e026cc9d7af req-f3beeef2-731e-450c-9a0a-1ce5729eb938 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:38.849605 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-d53fbd62-a9fa-43a7-b94a-1e026cc9d7af req-f3beeef2-731e-450c-9a0a-1ce5729eb938 service nova] Creating event network-vif-plugged:aa6313ae-aae7-4bf6-95d3-33dafde145dd for instance d6937382-84fd-4e0f-9efc-06044526bba2 on hv-cinder-83008 Feb 20 20:09:38.856982 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-d53fbd62-a9fa-43a7-b94a-1e026cc9d7af req-f3beeef2-731e-450c-9a0a-1ce5729eb938 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111724 Feb 20 20:09:38.858134 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 382/749] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:09:39.335242 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-94f492e3-503e-4ae8-b073-7e9489b2b4ff tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:39.335843 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-94f492e3-503e-4ae8-b073-7e9489b2b4ff tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:39.347652 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-94f492e3-503e-4ae8-b073-7e9489b2b4ff tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:39.348098 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-94f492e3-503e-4ae8-b073-7e9489b2b4ff tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:39.348983 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-94f492e3-503e-4ae8-b073-7e9489b2b4ff tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:39.349416 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-94f492e3-503e-4ae8-b073-7e9489b2b4ff tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:39.535154 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-94f492e3-503e-4ae8-b073-7e9489b2b4ff tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:39.543406 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-94f492e3-503e-4ae8-b073-7e9489b2b4ff tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2" status: 200 len: 1317 microversion: 2.1 time: 0.211876 Feb 20 20:09:39.543992 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 368/750] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:39 2022] GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2 => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:09:39.837357 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-856d8c3a-7b7b-432c-9ef2-4856850442dc tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:39.838779 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-856d8c3a-7b7b-432c-9ef2-4856850442dc tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:39.845677 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-856d8c3a-7b7b-432c-9ef2-4856850442dc tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:39.846123 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-856d8c3a-7b7b-432c-9ef2-4856850442dc tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:39.846917 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-856d8c3a-7b7b-432c-9ef2-4856850442dc tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:39.847355 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-856d8c3a-7b7b-432c-9ef2-4856850442dc tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:40.003496 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-856d8c3a-7b7b-432c-9ef2-4856850442dc tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:40.013016 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-856d8c3a-7b7b-432c-9ef2-4856850442dc tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1569 microversion: 2.1 time: 0.180214 Feb 20 20:09:40.013661 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 383/751] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:39 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:40.561080 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-0ad1a3fd-49c1-442e-80ea-e5760667d0fc tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:40.561728 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-0ad1a3fd-49c1-442e-80ea-e5760667d0fc tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:40.568803 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0ad1a3fd-49c1-442e-80ea-e5760667d0fc tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:40.569656 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0ad1a3fd-49c1-442e-80ea-e5760667d0fc tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:40.570127 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0ad1a3fd-49c1-442e-80ea-e5760667d0fc tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:40.575521 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0ad1a3fd-49c1-442e-80ea-e5760667d0fc tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:40.713471 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0ad1a3fd-49c1-442e-80ea-e5760667d0fc tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:40.722737 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-0ad1a3fd-49c1-442e-80ea-e5760667d0fc tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2" status: 200 len: 1317 microversion: 2.1 time: 0.166072 Feb 20 20:09:40.723331 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 369/752] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:40 2022] GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:41.031473 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b36e9264-bd55-4307-bb97-22cccfdf8c7c tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:41.032289 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b36e9264-bd55-4307-bb97-22cccfdf8c7c tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:41.038652 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b36e9264-bd55-4307-bb97-22cccfdf8c7c tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:41.039096 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b36e9264-bd55-4307-bb97-22cccfdf8c7c tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:41.039877 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b36e9264-bd55-4307-bb97-22cccfdf8c7c tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:41.040348 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b36e9264-bd55-4307-bb97-22cccfdf8c7c tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:41.186451 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b36e9264-bd55-4307-bb97-22cccfdf8c7c tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:41.194381 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b36e9264-bd55-4307-bb97-22cccfdf8c7c tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1569 microversion: 2.1 time: 0.166703 Feb 20 20:09:41.194956 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 384/753] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:41 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:41.740487 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ec4e8a59-924d-4163-8240-bb8fcd75da13 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:41.741487 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ec4e8a59-924d-4163-8240-bb8fcd75da13 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:41.750750 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ec4e8a59-924d-4163-8240-bb8fcd75da13 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:41.751220 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ec4e8a59-924d-4163-8240-bb8fcd75da13 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:41.752103 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ec4e8a59-924d-4163-8240-bb8fcd75da13 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:41.752536 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ec4e8a59-924d-4163-8240-bb8fcd75da13 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:41.893772 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ec4e8a59-924d-4163-8240-bb8fcd75da13 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:41.902048 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ec4e8a59-924d-4163-8240-bb8fcd75da13 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2" status: 200 len: 1507 microversion: 2.1 time: 0.166182 Feb 20 20:09:41.902620 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 370/754] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:41 2022] GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2 => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:42.211756 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-937dedcb-6e23-4e2f-b10f-8b01e9be7545 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:42.212339 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-937dedcb-6e23-4e2f-b10f-8b01e9be7545 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:42.220149 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-937dedcb-6e23-4e2f-b10f-8b01e9be7545 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:42.220603 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-937dedcb-6e23-4e2f-b10f-8b01e9be7545 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:42.221472 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-937dedcb-6e23-4e2f-b10f-8b01e9be7545 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:42.222040 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-937dedcb-6e23-4e2f-b10f-8b01e9be7545 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:42.371364 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-937dedcb-6e23-4e2f-b10f-8b01e9be7545 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:42.380068 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-937dedcb-6e23-4e2f-b10f-8b01e9be7545 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1569 microversion: 2.1 time: 0.170788 Feb 20 20:09:42.380068 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 385/755] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:42 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:09:43.399353 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1251c0a4-3c53-4e00-81bc-b6a704705ed7 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:43.400095 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1251c0a4-3c53-4e00-81bc-b6a704705ed7 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:43.407321 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1251c0a4-3c53-4e00-81bc-b6a704705ed7 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:43.407770 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1251c0a4-3c53-4e00-81bc-b6a704705ed7 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:43.408671 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1251c0a4-3c53-4e00-81bc-b6a704705ed7 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:43.410433 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1251c0a4-3c53-4e00-81bc-b6a704705ed7 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:43.619260 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1251c0a4-3c53-4e00-81bc-b6a704705ed7 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:43.619260 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1251c0a4-3c53-4e00-81bc-b6a704705ed7 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1569 microversion: 2.1 time: 0.215542 Feb 20 20:09:43.619260 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 371/756] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:43 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:43.809827 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4ef27536-a43a-4aa1-8952-8f3a353e05f3 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "528e11b5-36ca-4912-a97a-70c677663c04"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:09:43.810882 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4ef27536-a43a-4aa1-8952-8f3a353e05f3 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:43.817624 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ef27536-a43a-4aa1-8952-8f3a353e05f3 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:43.818065 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ef27536-a43a-4aa1-8952-8f3a353e05f3 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:43.818843 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ef27536-a43a-4aa1-8952-8f3a353e05f3 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:43.819274 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ef27536-a43a-4aa1-8952-8f3a353e05f3 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:44.628763 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7def6b1a-a093-48be-b257-0acaeffcd9f0 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:44.629425 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7def6b1a-a093-48be-b257-0acaeffcd9f0 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:44.635656 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7def6b1a-a093-48be-b257-0acaeffcd9f0 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:44.636111 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7def6b1a-a093-48be-b257-0acaeffcd9f0 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:44.636901 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7def6b1a-a093-48be-b257-0acaeffcd9f0 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:44.637943 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7def6b1a-a093-48be-b257-0acaeffcd9f0 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:44.730318 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4ef27536-a43a-4aa1-8952-8f3a353e05f3 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "POST /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.924739 Feb 20 20:09:44.731912 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 386/757] 10.222.0.60 () {60 vars in 1322 bytes} [Sun Feb 20 20:09:43 2022] POST /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2/os-volume_attachments => generated 194 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:09:44.811112 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7def6b1a-a093-48be-b257-0acaeffcd9f0 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:44.819465 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7def6b1a-a093-48be-b257-0acaeffcd9f0 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1569 microversion: 2.1 time: 0.194632 Feb 20 20:09:44.821805 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 372/758] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:44 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:09:45.839414 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-73dcdd81-320f-4531-a51c-6d6d52c59b0c tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:45.843938 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-73dcdd81-320f-4531-a51c-6d6d52c59b0c tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:45.849702 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-73dcdd81-320f-4531-a51c-6d6d52c59b0c tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:45.850156 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-73dcdd81-320f-4531-a51c-6d6d52c59b0c tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:45.851072 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-73dcdd81-320f-4531-a51c-6d6d52c59b0c tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:45.851689 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-73dcdd81-320f-4531-a51c-6d6d52c59b0c tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:46.025178 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-73dcdd81-320f-4531-a51c-6d6d52c59b0c tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:46.032791 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-73dcdd81-320f-4531-a51c-6d6d52c59b0c tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1569 microversion: 2.1 time: 0.198490 Feb 20 20:09:46.033394 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 387/759] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:45 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:46.817669 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7293de19-db54-4fca-a144-75e55c2d8eff tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:46.818912 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7293de19-db54-4fca-a144-75e55c2d8eff tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:46.825337 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7293de19-db54-4fca-a144-75e55c2d8eff tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:46.825717 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7293de19-db54-4fca-a144-75e55c2d8eff tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:46.826607 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7293de19-db54-4fca-a144-75e55c2d8eff tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:46.827029 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7293de19-db54-4fca-a144-75e55c2d8eff tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:46.862094 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7293de19-db54-4fca-a144-75e55c2d8eff tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048084 Feb 20 20:09:46.864847 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 373/760] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:09:46 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:09:47.050929 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8531340b-daac-4929-a65b-bed11a090f4e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:47.051745 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8531340b-daac-4929-a65b-bed11a090f4e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:47.058315 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8531340b-daac-4929-a65b-bed11a090f4e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:47.058760 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8531340b-daac-4929-a65b-bed11a090f4e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:47.060592 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8531340b-daac-4929-a65b-bed11a090f4e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:47.061032 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8531340b-daac-4929-a65b-bed11a090f4e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:47.320160 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8531340b-daac-4929-a65b-bed11a090f4e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:47.328098 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8531340b-daac-4929-a65b-bed11a090f4e tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1569 microversion: 2.1 time: 0.280805 Feb 20 20:09:47.328686 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 388/761] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:47 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1569 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:48.346359 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-59c9a8a0-eb87-4a1b-80b5-fb9aff469a5b tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:48.347069 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-59c9a8a0-eb87-4a1b-80b5-fb9aff469a5b tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:48.353642 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-59c9a8a0-eb87-4a1b-80b5-fb9aff469a5b tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:48.354120 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-59c9a8a0-eb87-4a1b-80b5-fb9aff469a5b tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:48.355027 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-59c9a8a0-eb87-4a1b-80b5-fb9aff469a5b tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:48.355460 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-59c9a8a0-eb87-4a1b-80b5-fb9aff469a5b tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:48.494646 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-59c9a8a0-eb87-4a1b-80b5-fb9aff469a5b tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:48.503122 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-59c9a8a0-eb87-4a1b-80b5-fb9aff469a5b tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1569 microversion: 2.1 time: 0.161010 Feb 20 20:09:48.503690 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 374/762] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:48 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:49.520679 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ab154887-d0f9-4aeb-ba90-62cf31648871 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:49.521308 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ab154887-d0f9-4aeb-ba90-62cf31648871 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:49.527697 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ab154887-d0f9-4aeb-ba90-62cf31648871 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:49.528447 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ab154887-d0f9-4aeb-ba90-62cf31648871 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:49.529463 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ab154887-d0f9-4aeb-ba90-62cf31648871 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:49.529899 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ab154887-d0f9-4aeb-ba90-62cf31648871 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:49.677913 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-ab154887-d0f9-4aeb-ba90-62cf31648871 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:49.686445 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ab154887-d0f9-4aeb-ba90-62cf31648871 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1569 microversion: 2.1 time: 0.169560 Feb 20 20:09:49.687040 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 389/763] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:49 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:50.704114 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f65c2add-4c1f-455a-9f2c-5e3962f2dcaa tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:50.705142 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f65c2add-4c1f-455a-9f2c-5e3962f2dcaa tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:50.712193 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f65c2add-4c1f-455a-9f2c-5e3962f2dcaa tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:50.712821 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f65c2add-4c1f-455a-9f2c-5e3962f2dcaa tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:50.713678 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f65c2add-4c1f-455a-9f2c-5e3962f2dcaa tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:50.714149 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f65c2add-4c1f-455a-9f2c-5e3962f2dcaa tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:50.949248 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f65c2add-4c1f-455a-9f2c-5e3962f2dcaa tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:50.961339 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f65c2add-4c1f-455a-9f2c-5e3962f2dcaa tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1569 microversion: 2.1 time: 0.261406 Feb 20 20:09:50.962063 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 375/764] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:50 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1569 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:51.988470 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-45376016-e348-487a-b76a-8d8e8cf29170 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:51.989081 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-45376016-e348-487a-b76a-8d8e8cf29170 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:51.995747 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-45376016-e348-487a-b76a-8d8e8cf29170 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:51.996184 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-45376016-e348-487a-b76a-8d8e8cf29170 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:51.997022 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-45376016-e348-487a-b76a-8d8e8cf29170 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:51.997481 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-45376016-e348-487a-b76a-8d8e8cf29170 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:52.148760 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-45376016-e348-487a-b76a-8d8e8cf29170 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:52.157937 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-45376016-e348-487a-b76a-8d8e8cf29170 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1570 microversion: 2.1 time: 0.173137 Feb 20 20:09:52.158747 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 390/765] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:51 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:52.187765 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-61aaa36e-9e01-4394-bd27-318ff55f52b0 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:09:52.188334 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-61aaa36e-9e01-4394-bd27-318ff55f52b0 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:52.195022 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-61aaa36e-9e01-4394-bd27-318ff55f52b0 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:52.195471 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-61aaa36e-9e01-4394-bd27-318ff55f52b0 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:52.196251 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-61aaa36e-9e01-4394-bd27-318ff55f52b0 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:52.196682 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-61aaa36e-9e01-4394-bd27-318ff55f52b0 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:52.481776 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-61aaa36e-9e01-4394-bd27-318ff55f52b0 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "POST /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b/action" status: 202 len: 0 microversion: 2.1 time: 0.297434 Feb 20 20:09:52.482415 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 376/766] 10.222.0.60 () {60 vars in 1277 bytes} [Sun Feb 20 20:09:52 2022] POST /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:09:52.490689 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8d5fb7dd-d0ce-4b4f-b0ac-1d0c29e832c7 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:52.491304 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8d5fb7dd-d0ce-4b4f-b0ac-1d0c29e832c7 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:52.498403 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8d5fb7dd-d0ce-4b4f-b0ac-1d0c29e832c7 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:52.498852 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8d5fb7dd-d0ce-4b4f-b0ac-1d0c29e832c7 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:52.499651 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8d5fb7dd-d0ce-4b4f-b0ac-1d0c29e832c7 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:52.500088 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8d5fb7dd-d0ce-4b4f-b0ac-1d0c29e832c7 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:52.663511 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8d5fb7dd-d0ce-4b4f-b0ac-1d0c29e832c7 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:52.672340 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8d5fb7dd-d0ce-4b4f-b0ac-1d0c29e832c7 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1518 microversion: 2.1 time: 0.185246 Feb 20 20:09:52.673322 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 391/767] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:52 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1518 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:52.677373 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-7b01a62d-25ed-4304-8a68-4d5ab7e3f028 req-8df3be64-fe22-4eaf-a7d5-ccb493027719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19d0359-a8b7-4b10-9423-86e7bc401f0b", "name": "network-vif-unplugged", "status": "completed", "tag": "24ada99e-5acc-483e-9242-a2920061f997"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:09:52.680539 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:09:52.680539 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:09:52.690436 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-7b01a62d-25ed-4304-8a68-4d5ab7e3f028 req-8df3be64-fe22-4eaf-a7d5-ccb493027719 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:52.690559 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-7b01a62d-25ed-4304-8a68-4d5ab7e3f028 req-8df3be64-fe22-4eaf-a7d5-ccb493027719 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:52.703940 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.compute.server_external_events [req-7b01a62d-25ed-4304-8a68-4d5ab7e3f028 req-8df3be64-fe22-4eaf-a7d5-ccb493027719 service nova] Unable to find a host for instance e19d0359-a8b7-4b10-9423-86e7bc401f0b. Dropping event network-vif-unplugged {{(pid=117087) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 20 20:09:52.704828 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-7b01a62d-25ed-4304-8a68-4d5ab7e3f028 req-8df3be64-fe22-4eaf-a7d5-ccb493027719 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033126 Feb 20 20:09:52.705895 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 377/768] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 20 20:09:53.689920 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-17f24783-d924-4498-a9bc-41a0440d8ed8 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:53.690858 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-17f24783-d924-4498-a9bc-41a0440d8ed8 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:53.697154 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-17f24783-d924-4498-a9bc-41a0440d8ed8 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:53.700947 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-17f24783-d924-4498-a9bc-41a0440d8ed8 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:53.700947 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-17f24783-d924-4498-a9bc-41a0440d8ed8 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:53.700947 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-17f24783-d924-4498-a9bc-41a0440d8ed8 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:53.847933 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-17f24783-d924-4498-a9bc-41a0440d8ed8 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:53.855934 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-17f24783-d924-4498-a9bc-41a0440d8ed8 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1518 microversion: 2.1 time: 0.169611 Feb 20 20:09:53.856518 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 392/769] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:53 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:54.467390 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-08b17ed5-2d1b-41fb-9ae6-e10a6ccbcc69 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:54.468087 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-08b17ed5-2d1b-41fb-9ae6-e10a6ccbcc69 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:54.474786 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-08b17ed5-2d1b-41fb-9ae6-e10a6ccbcc69 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:54.475236 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-08b17ed5-2d1b-41fb-9ae6-e10a6ccbcc69 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:54.476021 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-08b17ed5-2d1b-41fb-9ae6-e10a6ccbcc69 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:54.476458 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-08b17ed5-2d1b-41fb-9ae6-e10a6ccbcc69 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:54.562652 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-08b17ed5-2d1b-41fb-9ae6-e10a6ccbcc69 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lazy-loading 'services' on Instance uuid d6937382-84fd-4e0f-9efc-06044526bba2 {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:09:54.788895 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-08b17ed5-2d1b-41fb-9ae6-e10a6ccbcc69 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2/os-volume_attachments/528e11b5-36ca-4912-a97a-70c677663c04" status: 202 len: 0 microversion: 2.1 time: 0.325862 Feb 20 20:09:54.789527 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 378/770] 10.222.0.60 () {58 vars in 1415 bytes} [Sun Feb 20 20:09:54 2022] DELETE /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2/os-volume_attachments/528e11b5-36ca-4912-a97a-70c677663c04 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:09:54.798998 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ed7c8005-cfd2-4056-91ef-80651589ce45 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:54.799840 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ed7c8005-cfd2-4056-91ef-80651589ce45 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:54.806830 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ed7c8005-cfd2-4056-91ef-80651589ce45 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:54.807059 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ed7c8005-cfd2-4056-91ef-80651589ce45 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:54.807692 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ed7c8005-cfd2-4056-91ef-80651589ce45 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:54.808126 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ed7c8005-cfd2-4056-91ef-80651589ce45 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:54.841342 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ed7c8005-cfd2-4056-91ef-80651589ce45 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046029 Feb 20 20:09:54.841938 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 393/771] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:09:54 2022] GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:09:54.876308 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-fd3893da-03ee-42b8-b187-bd0ec3031419 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:54.877223 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-fd3893da-03ee-42b8-b187-bd0ec3031419 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:54.885025 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fd3893da-03ee-42b8-b187-bd0ec3031419 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:54.885509 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fd3893da-03ee-42b8-b187-bd0ec3031419 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:54.886293 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fd3893da-03ee-42b8-b187-bd0ec3031419 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:54.886730 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fd3893da-03ee-42b8-b187-bd0ec3031419 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:55.046034 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-fd3893da-03ee-42b8-b187-bd0ec3031419 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:55.056848 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-fd3893da-03ee-42b8-b187-bd0ec3031419 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1520 microversion: 2.1 time: 0.182483 Feb 20 20:09:55.056848 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 379/772] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:54 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:09:55.854029 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-fbf7a73b-1b41-4f50-b8aa-002cd1da866d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:55.855037 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-fbf7a73b-1b41-4f50-b8aa-002cd1da866d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:55.863558 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fbf7a73b-1b41-4f50-b8aa-002cd1da866d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:55.864005 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fbf7a73b-1b41-4f50-b8aa-002cd1da866d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:55.864785 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fbf7a73b-1b41-4f50-b8aa-002cd1da866d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:55.865246 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fbf7a73b-1b41-4f50-b8aa-002cd1da866d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:55.899726 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-fbf7a73b-1b41-4f50-b8aa-002cd1da866d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049511 Feb 20 20:09:55.900328 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 394/773] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:09:55 2022] GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:09:56.071911 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e38b7b83-5e5e-4aa2-b9a1-4534dbb3432a tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:56.072576 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e38b7b83-5e5e-4aa2-b9a1-4534dbb3432a tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:56.079651 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e38b7b83-5e5e-4aa2-b9a1-4534dbb3432a tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:56.080104 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e38b7b83-5e5e-4aa2-b9a1-4534dbb3432a tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:56.085327 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e38b7b83-5e5e-4aa2-b9a1-4534dbb3432a tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:56.085327 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e38b7b83-5e5e-4aa2-b9a1-4534dbb3432a tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:56.234861 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e38b7b83-5e5e-4aa2-b9a1-4534dbb3432a tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:56.242703 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e38b7b83-5e5e-4aa2-b9a1-4534dbb3432a tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1520 microversion: 2.1 time: 0.174636 Feb 20 20:09:56.243288 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 380/774] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:56 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:56.913864 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ce98e86b-06bb-49c4-aa8f-d7aa1d4ea8fb tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:56.914766 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ce98e86b-06bb-49c4-aa8f-d7aa1d4ea8fb tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:56.921475 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ce98e86b-06bb-49c4-aa8f-d7aa1d4ea8fb tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:56.921920 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ce98e86b-06bb-49c4-aa8f-d7aa1d4ea8fb tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:56.922712 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ce98e86b-06bb-49c4-aa8f-d7aa1d4ea8fb tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:56.923136 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ce98e86b-06bb-49c4-aa8f-d7aa1d4ea8fb tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:56.956657 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ce98e86b-06bb-49c4-aa8f-d7aa1d4ea8fb tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046555 Feb 20 20:09:56.957274 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 395/775] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:09:56 2022] GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:09:57.264636 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-eaacfc41-ab85-42ae-a234-fef347793159 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:57.265578 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-eaacfc41-ab85-42ae-a234-fef347793159 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:57.272362 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-eaacfc41-ab85-42ae-a234-fef347793159 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:57.272812 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-eaacfc41-ab85-42ae-a234-fef347793159 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:57.273643 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-eaacfc41-ab85-42ae-a234-fef347793159 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:57.274136 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-eaacfc41-ab85-42ae-a234-fef347793159 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:57.800707 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-eaacfc41-ab85-42ae-a234-fef347793159 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:57.808635 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-eaacfc41-ab85-42ae-a234-fef347793159 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1576 microversion: 2.1 time: 0.548659 Feb 20 20:09:57.810174 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 381/776] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:57 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1576 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:57.969025 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-aca65736-6a30-41b4-b159-5d67c8f2874d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:57.970363 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-aca65736-6a30-41b4-b159-5d67c8f2874d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:57.977491 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aca65736-6a30-41b4-b159-5d67c8f2874d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:57.978008 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aca65736-6a30-41b4-b159-5d67c8f2874d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:57.978746 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aca65736-6a30-41b4-b159-5d67c8f2874d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:57.979186 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aca65736-6a30-41b4-b159-5d67c8f2874d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:58.011369 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-aca65736-6a30-41b4-b159-5d67c8f2874d tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047224 Feb 20 20:09:58.012617 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 396/777] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:09:57 2022] GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 20 20:09:58.827229 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-790772da-90b0-4cc1-b146-94e9da880866 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:58.827997 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-790772da-90b0-4cc1-b146-94e9da880866 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:58.835147 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-790772da-90b0-4cc1-b146-94e9da880866 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:58.835639 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-790772da-90b0-4cc1-b146-94e9da880866 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:58.836483 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-790772da-90b0-4cc1-b146-94e9da880866 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:58.836950 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-790772da-90b0-4cc1-b146-94e9da880866 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:58.984895 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-790772da-90b0-4cc1-b146-94e9da880866 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:58.995006 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-790772da-90b0-4cc1-b146-94e9da880866 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1576 microversion: 2.1 time: 0.171601 Feb 20 20:09:58.995600 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 382/778] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:58 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:09:59.451287 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-23578e56-3228-4776-8124-56619ea41c68 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:59.451822 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-23578e56-3228-4776-8124-56619ea41c68 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:59.459002 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-23578e56-3228-4776-8124-56619ea41c68 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:59.459439 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-23578e56-3228-4776-8124-56619ea41c68 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:59.460206 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-23578e56-3228-4776-8124-56619ea41c68 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:59.460628 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-23578e56-3228-4776-8124-56619ea41c68 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:59.498702 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-23578e56-3228-4776-8124-56619ea41c68 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 20 20:09:59.811405 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-23578e56-3228-4776-8124-56619ea41c68 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2" status: 204 len: 0 microversion: 2.1 time: 0.363429 Feb 20 20:09:59.812001 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 397/779] 10.222.0.60 () {58 vars in 1238 bytes} [Sun Feb 20 20:09:59 2022] DELETE /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 20 20:09:59.819774 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-933e78a8-dcc6-4dd6-bf29-41ac586d3938 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:09:59.820386 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-933e78a8-dcc6-4dd6-bf29-41ac586d3938 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:09:59.827663 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-933e78a8-dcc6-4dd6-bf29-41ac586d3938 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:59.828282 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-933e78a8-dcc6-4dd6-bf29-41ac586d3938 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:59.828887 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-933e78a8-dcc6-4dd6-bf29-41ac586d3938 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:09:59.829350 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-933e78a8-dcc6-4dd6-bf29-41ac586d3938 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:09:59.975942 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-933e78a8-dcc6-4dd6-bf29-41ac586d3938 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:09:59.983650 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-933e78a8-dcc6-4dd6-bf29-41ac586d3938 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2" status: 200 len: 1513 microversion: 2.1 time: 0.167467 Feb 20 20:09:59.984269 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 383/780] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:09:59 2022] GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:10:00.014961 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7cdc47fe-3b00-48d0-84e0-aa836a97bb99 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:00.015987 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7cdc47fe-3b00-48d0-84e0-aa836a97bb99 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:00.022658 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7cdc47fe-3b00-48d0-84e0-aa836a97bb99 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:00.026847 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7cdc47fe-3b00-48d0-84e0-aa836a97bb99 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:00.026847 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7cdc47fe-3b00-48d0-84e0-aa836a97bb99 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:00.026847 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7cdc47fe-3b00-48d0-84e0-aa836a97bb99 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:00.169348 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7cdc47fe-3b00-48d0-84e0-aa836a97bb99 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:00.176825 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7cdc47fe-3b00-48d0-84e0-aa836a97bb99 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1576 microversion: 2.1 time: 0.167550 Feb 20 20:10:00.177430 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 398/781] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:00 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:01.001867 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-66277353-53fa-4d88-be3b-f4a1600dab3c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:01.002504 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-66277353-53fa-4d88-be3b-f4a1600dab3c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:01.008935 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-66277353-53fa-4d88-be3b-f4a1600dab3c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:01.009410 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-66277353-53fa-4d88-be3b-f4a1600dab3c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:01.010188 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-66277353-53fa-4d88-be3b-f4a1600dab3c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:01.010621 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-66277353-53fa-4d88-be3b-f4a1600dab3c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:01.155921 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-66277353-53fa-4d88-be3b-f4a1600dab3c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:01.163436 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-66277353-53fa-4d88-be3b-f4a1600dab3c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2" status: 200 len: 1513 microversion: 2.1 time: 0.165154 Feb 20 20:10:01.164015 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 384/782] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:00 2022] GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:01.195069 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-90c4e340-17d6-46dc-b48e-1b50ccc46852 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:01.195659 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-90c4e340-17d6-46dc-b48e-1b50ccc46852 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:01.202345 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-90c4e340-17d6-46dc-b48e-1b50ccc46852 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:01.202788 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-90c4e340-17d6-46dc-b48e-1b50ccc46852 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:01.203630 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-90c4e340-17d6-46dc-b48e-1b50ccc46852 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:01.204058 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-90c4e340-17d6-46dc-b48e-1b50ccc46852 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:01.344418 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-90c4e340-17d6-46dc-b48e-1b50ccc46852 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:01.352181 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-90c4e340-17d6-46dc-b48e-1b50ccc46852 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1576 microversion: 2.1 time: 0.160755 Feb 20 20:10:01.352674 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 399/783] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:01 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:02.181798 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-46c7b41b-23f1-41c6-a3ba-d366be82b1c1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:02.182540 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-46c7b41b-23f1-41c6-a3ba-d366be82b1c1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:02.189948 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-46c7b41b-23f1-41c6-a3ba-d366be82b1c1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:02.190434 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-46c7b41b-23f1-41c6-a3ba-d366be82b1c1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:02.191343 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-46c7b41b-23f1-41c6-a3ba-d366be82b1c1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:02.191802 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-46c7b41b-23f1-41c6-a3ba-d366be82b1c1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:02.369877 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-1f7d72ba-c3b2-4210-929a-254c0ae21bc1 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:02.370480 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-1f7d72ba-c3b2-4210-929a-254c0ae21bc1 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:02.378116 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1f7d72ba-c3b2-4210-929a-254c0ae21bc1 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:02.378563 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1f7d72ba-c3b2-4210-929a-254c0ae21bc1 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:02.379351 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1f7d72ba-c3b2-4210-929a-254c0ae21bc1 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:02.379779 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1f7d72ba-c3b2-4210-929a-254c0ae21bc1 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:02.441953 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-46c7b41b-23f1-41c6-a3ba-d366be82b1c1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:02.449853 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-46c7b41b-23f1-41c6-a3ba-d366be82b1c1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2" status: 200 len: 1513 microversion: 2.1 time: 0.271389 Feb 20 20:10:02.450400 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 385/784] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:02 2022] GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2 => generated 1513 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:02.622162 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-1f7d72ba-c3b2-4210-929a-254c0ae21bc1 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:02.629931 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-1f7d72ba-c3b2-4210-929a-254c0ae21bc1 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1576 microversion: 2.1 time: 0.264106 Feb 20 20:10:02.630518 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 400/785] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:02 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1576 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:10:02.854709 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-c8f917d1-62a1-4069-a46b-1f3eddc4c285 req-c4300a0f-8262-4a9c-8935-cffa49478114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6937382-84fd-4e0f-9efc-06044526bba2", "name": "network-vif-deleted", "tag": "aa6313ae-aae7-4bf6-95d3-33dafde145dd"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:10:02.856490 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:10:02.856490 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:10:02.863376 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-c8f917d1-62a1-4069-a46b-1f3eddc4c285 req-c4300a0f-8262-4a9c-8935-cffa49478114 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:02.865128 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-c8f917d1-62a1-4069-a46b-1f3eddc4c285 req-c4300a0f-8262-4a9c-8935-cffa49478114 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:02.879408 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-c8f917d1-62a1-4069-a46b-1f3eddc4c285 req-c4300a0f-8262-4a9c-8935-cffa49478114 service nova] Creating event network-vif-deleted:aa6313ae-aae7-4bf6-95d3-33dafde145dd for instance d6937382-84fd-4e0f-9efc-06044526bba2 on hv-cinder-83008 Feb 20 20:10:02.886415 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-c8f917d1-62a1-4069-a46b-1f3eddc4c285 req-c4300a0f-8262-4a9c-8935-cffa49478114 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035510 Feb 20 20:10:02.887678 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 386/786] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:10:03.468102 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2aa2d640-2c64-4f2e-97fd-ba9cc7d73e97 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:03.468739 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2aa2d640-2c64-4f2e-97fd-ba9cc7d73e97 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:03.475580 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2aa2d640-2c64-4f2e-97fd-ba9cc7d73e97 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:03.476327 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2aa2d640-2c64-4f2e-97fd-ba9cc7d73e97 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:03.476645 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2aa2d640-2c64-4f2e-97fd-ba9cc7d73e97 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:03.477101 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2aa2d640-2c64-4f2e-97fd-ba9cc7d73e97 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:03.509232 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2aa2d640-2c64-4f2e-97fd-ba9cc7d73e97 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:03.509668 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2aa2d640-2c64-4f2e-97fd-ba9cc7d73e97 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:03.510104 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-2aa2d640-2c64-4f2e-97fd-ba9cc7d73e97 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lazy-loading 'fault' on Instance uuid d6937382-84fd-4e0f-9efc-06044526bba2 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:10:03.551387 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2aa2d640-2c64-4f2e-97fd-ba9cc7d73e97 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:03.559752 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2aa2d640-2c64-4f2e-97fd-ba9cc7d73e97 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2" status: 200 len: 1307 microversion: 2.1 time: 0.095822 Feb 20 20:10:03.560477 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 401/787] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:03 2022] GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2 => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:03.648206 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2a46f55e-1c65-44bd-b1c4-825aaa2cbda2 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:03.648915 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2a46f55e-1c65-44bd-b1c4-825aaa2cbda2 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:03.656697 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2a46f55e-1c65-44bd-b1c4-825aaa2cbda2 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:03.657177 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2a46f55e-1c65-44bd-b1c4-825aaa2cbda2 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:03.657987 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2a46f55e-1c65-44bd-b1c4-825aaa2cbda2 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:03.658424 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2a46f55e-1c65-44bd-b1c4-825aaa2cbda2 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:03.808662 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2a46f55e-1c65-44bd-b1c4-825aaa2cbda2 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:03.819607 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2a46f55e-1c65-44bd-b1c4-825aaa2cbda2 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1576 microversion: 2.1 time: 0.175181 Feb 20 20:10:03.820447 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 387/788] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:03 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:04.368922 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-fe0b7613-aaab-4a89-8f37-723f667e9ec0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:10:04.369388 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-fe0b7613-aaab-4a89-8f37-723f667e9ec0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:04.377019 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fe0b7613-aaab-4a89-8f37-723f667e9ec0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:04.377488 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fe0b7613-aaab-4a89-8f37-723f667e9ec0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:04.378267 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fe0b7613-aaab-4a89-8f37-723f667e9ec0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:04.378714 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fe0b7613-aaab-4a89-8f37-723f667e9ec0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:04.402195 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-fe0b7613-aaab-4a89-8f37-723f667e9ec0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lazy-loading 'flavor' on Instance uuid d2f60f31-e3e4-4705-910a-d01bdba1d965 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:10:04.578340 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5e828c7f-8e24-4ba4-86dc-ba864fe3b712 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:04.578942 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5e828c7f-8e24-4ba4-86dc-ba864fe3b712 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: d6937382-84fd-4e0f-9efc-06044526bba2] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:04.584845 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5e828c7f-8e24-4ba4-86dc-ba864fe3b712 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:04.585309 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5e828c7f-8e24-4ba4-86dc-ba864fe3b712 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:04.586239 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5e828c7f-8e24-4ba4-86dc-ba864fe3b712 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:04.586542 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5e828c7f-8e24-4ba4-86dc-ba864fe3b712 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:04.602939 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-5e828c7f-8e24-4ba4-86dc-ba864fe3b712 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] HTTP exception thrown: Instance d6937382-84fd-4e0f-9efc-06044526bba2 could not be found. Feb 20 20:10:04.603526 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5e828c7f-8e24-4ba4-86dc-ba864fe3b712 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Returning 404 to user: Instance d6937382-84fd-4e0f-9efc-06044526bba2 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:10:04.604348 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5e828c7f-8e24-4ba4-86dc-ba864fe3b712 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2" status: 404 len: 111 microversion: 2.1 time: 0.030579 Feb 20 20:10:04.604899 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 388/789] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:04 2022] GET /compute/v2.1/servers/d6937382-84fd-4e0f-9efc-06044526bba2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 20 20:10:04.841344 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-498969cd-120d-47f5-9287-eae3c72042b4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:04.842074 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-498969cd-120d-47f5-9287-eae3c72042b4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:04.849312 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-498969cd-120d-47f5-9287-eae3c72042b4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:04.849757 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-498969cd-120d-47f5-9287-eae3c72042b4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:04.850582 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-498969cd-120d-47f5-9287-eae3c72042b4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:04.851027 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-498969cd-120d-47f5-9287-eae3c72042b4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:05.022727 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-498969cd-120d-47f5-9287-eae3c72042b4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:05.030592 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-498969cd-120d-47f5-9287-eae3c72042b4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1576 microversion: 2.1 time: 0.194159 Feb 20 20:10:05.031837 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 389/790] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:04 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1576 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:10:05.307664 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-fe0b7613-aaab-4a89-8f37-723f667e9ec0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "POST /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965/action" status: 202 len: 0 microversion: 2.20 time: 0.942271 Feb 20 20:10:05.308442 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 402/791] 10.222.0.60 () {62 vars in 1318 bytes} [Sun Feb 20 20:10:04 2022] POST /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965/action => generated 0 bytes in 944 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 20 20:10:05.317511 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b1d4fcc6-e802-4af9-afbf-353d5208a3bf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:05.318443 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b1d4fcc6-e802-4af9-afbf-353d5208a3bf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:05.324388 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b1d4fcc6-e802-4af9-afbf-353d5208a3bf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:05.324885 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b1d4fcc6-e802-4af9-afbf-353d5208a3bf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:05.326321 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b1d4fcc6-e802-4af9-afbf-353d5208a3bf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:05.326780 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b1d4fcc6-e802-4af9-afbf-353d5208a3bf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:05.470092 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b1d4fcc6-e802-4af9-afbf-353d5208a3bf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:05.478610 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b1d4fcc6-e802-4af9-afbf-353d5208a3bf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:05.480426 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b1d4fcc6-e802-4af9-afbf-353d5208a3bf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:05.482242 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b1d4fcc6-e802-4af9-afbf-353d5208a3bf tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1723 microversion: 2.20 time: 0.168983 Feb 20 20:10:05.482801 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 390/792] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:05 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:06.050197 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b489ed42-34d4-4e24-873b-40371bfbfa8f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:06.050891 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b489ed42-34d4-4e24-873b-40371bfbfa8f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:06.057435 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b489ed42-34d4-4e24-873b-40371bfbfa8f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:06.057882 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b489ed42-34d4-4e24-873b-40371bfbfa8f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:06.058716 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b489ed42-34d4-4e24-873b-40371bfbfa8f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:06.059225 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b489ed42-34d4-4e24-873b-40371bfbfa8f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:06.157432 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-508bce5c-6a79-445d-97e5-939e8ddfdfd9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:06.157972 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-508bce5c-6a79-445d-97e5-939e8ddfdfd9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:06.164326 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-508bce5c-6a79-445d-97e5-939e8ddfdfd9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:06.164770 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-508bce5c-6a79-445d-97e5-939e8ddfdfd9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:06.165573 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-508bce5c-6a79-445d-97e5-939e8ddfdfd9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:06.166009 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-508bce5c-6a79-445d-97e5-939e8ddfdfd9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:06.191941 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-508bce5c-6a79-445d-97e5-939e8ddfdfd9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Going to try to terminate instance {{(pid=117087) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 20 20:10:06.207704 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b489ed42-34d4-4e24-873b-40371bfbfa8f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:06.215100 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b489ed42-34d4-4e24-873b-40371bfbfa8f tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1576 microversion: 2.1 time: 0.169599 Feb 20 20:10:06.216172 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 403/793] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:06 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:10:06.502232 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c19fe3d7-9dc0-4d63-8139-e94007b41f1a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:06.502866 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c19fe3d7-9dc0-4d63-8139-e94007b41f1a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:06.508808 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c19fe3d7-9dc0-4d63-8139-e94007b41f1a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:06.515694 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c19fe3d7-9dc0-4d63-8139-e94007b41f1a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:06.515694 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c19fe3d7-9dc0-4d63-8139-e94007b41f1a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:06.515694 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c19fe3d7-9dc0-4d63-8139-e94007b41f1a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:06.668225 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c19fe3d7-9dc0-4d63-8139-e94007b41f1a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:06.674180 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-508bce5c-6a79-445d-97e5-939e8ddfdfd9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "DELETE /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865" status: 204 len: 0 microversion: 2.1 time: 0.520630 Feb 20 20:10:06.674877 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 391/794] 10.222.0.60 () {58 vars in 1238 bytes} [Sun Feb 20 20:10:06 2022] DELETE /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 20 20:10:06.678494 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c19fe3d7-9dc0-4d63-8139-e94007b41f1a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:06.680088 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c19fe3d7-9dc0-4d63-8139-e94007b41f1a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:06.681367 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c19fe3d7-9dc0-4d63-8139-e94007b41f1a tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1723 microversion: 2.20 time: 0.182904 Feb 20 20:10:06.682646 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 404/795] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:06 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:10:06.684901 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e4809ecd-7ee1-4b6b-aa47-e9d6d098601e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:06.685651 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e4809ecd-7ee1-4b6b-aa47-e9d6d098601e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:06.698867 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e4809ecd-7ee1-4b6b-aa47-e9d6d098601e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:06.698867 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e4809ecd-7ee1-4b6b-aa47-e9d6d098601e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:06.698867 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e4809ecd-7ee1-4b6b-aa47-e9d6d098601e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:06.698867 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e4809ecd-7ee1-4b6b-aa47-e9d6d098601e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:06.859837 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e4809ecd-7ee1-4b6b-aa47-e9d6d098601e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:06.868427 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e4809ecd-7ee1-4b6b-aa47-e9d6d098601e tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865" status: 200 len: 1515 microversion: 2.1 time: 0.188092 Feb 20 20:10:06.869013 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 392/796] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:06 2022] GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865 => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:07.234536 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-43b1a067-d7ff-4a39-b3c0-79a5e61694a4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:07.235141 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-43b1a067-d7ff-4a39-b3c0-79a5e61694a4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:07.241721 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-43b1a067-d7ff-4a39-b3c0-79a5e61694a4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:07.242158 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-43b1a067-d7ff-4a39-b3c0-79a5e61694a4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:07.242925 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-43b1a067-d7ff-4a39-b3c0-79a5e61694a4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:07.243347 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-43b1a067-d7ff-4a39-b3c0-79a5e61694a4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:07.395420 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-43b1a067-d7ff-4a39-b3c0-79a5e61694a4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:07.403228 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-43b1a067-d7ff-4a39-b3c0-79a5e61694a4 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1576 microversion: 2.1 time: 0.173274 Feb 20 20:10:07.403855 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 405/797] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:07 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:07.716123 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-95c24d17-1821-4352-b6dc-72fc787f40c4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:07.716831 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-95c24d17-1821-4352-b6dc-72fc787f40c4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:07.723474 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-95c24d17-1821-4352-b6dc-72fc787f40c4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:07.723923 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-95c24d17-1821-4352-b6dc-72fc787f40c4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:07.724707 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-95c24d17-1821-4352-b6dc-72fc787f40c4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:07.725170 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-95c24d17-1821-4352-b6dc-72fc787f40c4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:07.865942 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-95c24d17-1821-4352-b6dc-72fc787f40c4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:07.875355 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-95c24d17-1821-4352-b6dc-72fc787f40c4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:07.877247 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-95c24d17-1821-4352-b6dc-72fc787f40c4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:07.878441 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-95c24d17-1821-4352-b6dc-72fc787f40c4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1723 microversion: 2.20 time: 0.166166 Feb 20 20:10:07.879005 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 393/798] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:07 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:07.885847 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-86719cc7-7753-42e0-92c5-e9ed552ce72b tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:07.886639 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-86719cc7-7753-42e0-92c5-e9ed552ce72b tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:07.893317 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-86719cc7-7753-42e0-92c5-e9ed552ce72b tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:07.893756 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-86719cc7-7753-42e0-92c5-e9ed552ce72b tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:07.894572 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-86719cc7-7753-42e0-92c5-e9ed552ce72b tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:07.894958 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-86719cc7-7753-42e0-92c5-e9ed552ce72b tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:08.031402 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-86719cc7-7753-42e0-92c5-e9ed552ce72b tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:08.038787 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-86719cc7-7753-42e0-92c5-e9ed552ce72b tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865" status: 200 len: 1515 microversion: 2.1 time: 0.156519 Feb 20 20:10:08.039389 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 406/799] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:07 2022] GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:08.420396 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8d1d4786-4d78-4fbb-8f57-6d3e5cb69e89 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:08.421200 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8d1d4786-4d78-4fbb-8f57-6d3e5cb69e89 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:08.428188 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8d1d4786-4d78-4fbb-8f57-6d3e5cb69e89 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:08.428636 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8d1d4786-4d78-4fbb-8f57-6d3e5cb69e89 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:08.429494 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8d1d4786-4d78-4fbb-8f57-6d3e5cb69e89 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:08.429998 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8d1d4786-4d78-4fbb-8f57-6d3e5cb69e89 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:08.570507 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8d1d4786-4d78-4fbb-8f57-6d3e5cb69e89 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:08.578414 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8d1d4786-4d78-4fbb-8f57-6d3e5cb69e89 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1576 microversion: 2.1 time: 0.162371 Feb 20 20:10:08.578978 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 394/800] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:08 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:08.802025 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-97e2f1e4-4ea2-4da5-8b96-88008d1fe40c req-c5dadda8-1c11-4f69-8ef5-7efb7bcb0018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19d0359-a8b7-4b10-9423-86e7bc401f0b", "name": "network-vif-plugged", "status": "completed", "tag": "24ada99e-5acc-483e-9242-a2920061f997"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:10:08.807908 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:10:08.807908 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:10:08.815699 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-97e2f1e4-4ea2-4da5-8b96-88008d1fe40c req-c5dadda8-1c11-4f69-8ef5-7efb7bcb0018 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:08.816394 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-97e2f1e4-4ea2-4da5-8b96-88008d1fe40c req-c5dadda8-1c11-4f69-8ef5-7efb7bcb0018 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:08.831697 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-97e2f1e4-4ea2-4da5-8b96-88008d1fe40c req-c5dadda8-1c11-4f69-8ef5-7efb7bcb0018 service nova] Creating event network-vif-plugged:24ada99e-5acc-483e-9242-a2920061f997 for instance e19d0359-a8b7-4b10-9423-86e7bc401f0b on hv-cinder-83008 Feb 20 20:10:08.836793 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-97e2f1e4-4ea2-4da5-8b96-88008d1fe40c req-c5dadda8-1c11-4f69-8ef5-7efb7bcb0018 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038886 Feb 20 20:10:08.839857 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 407/801] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:10:08.898901 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5d938fdd-a7b7-43cb-ac6f-ad44543995cc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:08.899761 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5d938fdd-a7b7-43cb-ac6f-ad44543995cc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:08.906743 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5d938fdd-a7b7-43cb-ac6f-ad44543995cc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:08.907185 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5d938fdd-a7b7-43cb-ac6f-ad44543995cc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:08.907980 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5d938fdd-a7b7-43cb-ac6f-ad44543995cc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:08.908409 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5d938fdd-a7b7-43cb-ac6f-ad44543995cc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:09.056121 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-da6f247e-f295-4220-bb95-1ba0d0558ac5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:09.056825 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-da6f247e-f295-4220-bb95-1ba0d0558ac5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:09.064281 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-da6f247e-f295-4220-bb95-1ba0d0558ac5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:09.064732 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-da6f247e-f295-4220-bb95-1ba0d0558ac5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:09.065588 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-da6f247e-f295-4220-bb95-1ba0d0558ac5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:09.066048 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-da6f247e-f295-4220-bb95-1ba0d0558ac5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:09.166715 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5d938fdd-a7b7-43cb-ac6f-ad44543995cc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:09.181285 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5d938fdd-a7b7-43cb-ac6f-ad44543995cc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:09.183893 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5d938fdd-a7b7-43cb-ac6f-ad44543995cc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:09.185862 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5d938fdd-a7b7-43cb-ac6f-ad44543995cc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1723 microversion: 2.20 time: 0.290609 Feb 20 20:10:09.198274 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 395/802] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:08 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1723 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:09.302004 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-da6f247e-f295-4220-bb95-1ba0d0558ac5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:09.309463 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-da6f247e-f295-4220-bb95-1ba0d0558ac5 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865" status: 200 len: 1515 microversion: 2.1 time: 0.257369 Feb 20 20:10:09.310063 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 408/803] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:09 2022] GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865 => generated 1515 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:10:09.443081 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-6e8a8010-12f8-469d-b86f-6d534aea1754 req-1ca99d6e-19c4-440b-8e7d-cc86b4d22769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "663894bf-b677-40cf-8c2f-db3bc1531865", "name": "network-vif-deleted", "tag": "04c29bfa-c7dd-4a87-8d83-65625078dd50"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:10:09.446240 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:10:09.446240 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:10:09.453189 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-6e8a8010-12f8-469d-b86f-6d534aea1754 req-1ca99d6e-19c4-440b-8e7d-cc86b4d22769 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:09.453623 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-6e8a8010-12f8-469d-b86f-6d534aea1754 req-1ca99d6e-19c4-440b-8e7d-cc86b4d22769 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:09.464362 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-6e8a8010-12f8-469d-b86f-6d534aea1754 req-1ca99d6e-19c4-440b-8e7d-cc86b4d22769 service nova] Creating event network-vif-deleted:04c29bfa-c7dd-4a87-8d83-65625078dd50 for instance 663894bf-b677-40cf-8c2f-db3bc1531865 on hv-cinder-83008 Feb 20 20:10:09.470592 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-6e8a8010-12f8-469d-b86f-6d534aea1754 req-1ca99d6e-19c4-440b-8e7d-cc86b4d22769 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031548 Feb 20 20:10:09.471191 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 396/804] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:10:09.596200 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-fab448fc-7ec4-4d93-afe9-ac8c125b3875 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:09.596719 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-fab448fc-7ec4-4d93-afe9-ac8c125b3875 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:09.602861 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fab448fc-7ec4-4d93-afe9-ac8c125b3875 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:09.603594 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fab448fc-7ec4-4d93-afe9-ac8c125b3875 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:09.604892 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fab448fc-7ec4-4d93-afe9-ac8c125b3875 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:09.605443 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fab448fc-7ec4-4d93-afe9-ac8c125b3875 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:09.759503 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-fab448fc-7ec4-4d93-afe9-ac8c125b3875 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:09.768629 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-fab448fc-7ec4-4d93-afe9-ac8c125b3875 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1576 microversion: 2.1 time: 0.176510 Feb 20 20:10:09.769272 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 409/805] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:09 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:10.207332 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-990c481f-10e1-445e-acc4-feef9da9ec64 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:10.208036 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-990c481f-10e1-445e-acc4-feef9da9ec64 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:10.214494 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-990c481f-10e1-445e-acc4-feef9da9ec64 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:10.214973 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-990c481f-10e1-445e-acc4-feef9da9ec64 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:10.215739 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-990c481f-10e1-445e-acc4-feef9da9ec64 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:10.216169 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-990c481f-10e1-445e-acc4-feef9da9ec64 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:10.326775 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-92d0754b-d19e-48da-8172-c940820cd640 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:10.327477 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-92d0754b-d19e-48da-8172-c940820cd640 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:10.334322 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-92d0754b-d19e-48da-8172-c940820cd640 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:10.334813 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-92d0754b-d19e-48da-8172-c940820cd640 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:10.335823 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-92d0754b-d19e-48da-8172-c940820cd640 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:10.336321 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-92d0754b-d19e-48da-8172-c940820cd640 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:10.368221 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-990c481f-10e1-445e-acc4-feef9da9ec64 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:10.368413 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-92d0754b-d19e-48da-8172-c940820cd640 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:10.368669 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-92d0754b-d19e-48da-8172-c940820cd640 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:10.369133 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-92d0754b-d19e-48da-8172-c940820cd640 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lazy-loading 'fault' on Instance uuid 663894bf-b677-40cf-8c2f-db3bc1531865 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:10:10.377850 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-990c481f-10e1-445e-acc4-feef9da9ec64 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:10.379384 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-990c481f-10e1-445e-acc4-feef9da9ec64 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:10.380550 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-990c481f-10e1-445e-acc4-feef9da9ec64 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1723 microversion: 2.20 time: 0.178710 Feb 20 20:10:10.391912 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 397/806] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:10 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:10.414801 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-92d0754b-d19e-48da-8172-c940820cd640 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:10.423619 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-92d0754b-d19e-48da-8172-c940820cd640 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865" status: 200 len: 1308 microversion: 2.1 time: 0.099981 Feb 20 20:10:10.424220 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 410/807] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:10 2022] GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:10:10.786821 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ed827a2d-12da-4321-a7b5-16a2e5b00076 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:10.787347 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ed827a2d-12da-4321-a7b5-16a2e5b00076 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:10.793575 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ed827a2d-12da-4321-a7b5-16a2e5b00076 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:10.794022 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ed827a2d-12da-4321-a7b5-16a2e5b00076 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:10.794808 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ed827a2d-12da-4321-a7b5-16a2e5b00076 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:10.795242 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ed827a2d-12da-4321-a7b5-16a2e5b00076 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:10.942298 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ed827a2d-12da-4321-a7b5-16a2e5b00076 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:10.949707 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ed827a2d-12da-4321-a7b5-16a2e5b00076 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1563 microversion: 2.1 time: 0.167203 Feb 20 20:10:10.950264 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 398/808] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:10 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:10:11.399023 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a749d731-b994-4607-9d75-df52195c78af tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:11.399609 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a749d731-b994-4607-9d75-df52195c78af tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:11.406654 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a749d731-b994-4607-9d75-df52195c78af tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:11.407098 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a749d731-b994-4607-9d75-df52195c78af tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:11.407970 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a749d731-b994-4607-9d75-df52195c78af tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:11.408399 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a749d731-b994-4607-9d75-df52195c78af tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:11.441530 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1ed10e47-e2f4-4808-a6d0-4c6c8f745a8f tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:11.442404 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1ed10e47-e2f4-4808-a6d0-4c6c8f745a8f tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: 663894bf-b677-40cf-8c2f-db3bc1531865] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:11.449487 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1ed10e47-e2f4-4808-a6d0-4c6c8f745a8f tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:11.450034 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1ed10e47-e2f4-4808-a6d0-4c6c8f745a8f tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:11.450897 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1ed10e47-e2f4-4808-a6d0-4c6c8f745a8f tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:11.451339 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1ed10e47-e2f4-4808-a6d0-4c6c8f745a8f tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:11.467983 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-1ed10e47-e2f4-4808-a6d0-4c6c8f745a8f tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] HTTP exception thrown: Instance 663894bf-b677-40cf-8c2f-db3bc1531865 could not be found. Feb 20 20:10:11.469059 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1ed10e47-e2f4-4808-a6d0-4c6c8f745a8f tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Returning 404 to user: Instance 663894bf-b677-40cf-8c2f-db3bc1531865 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:10:11.470538 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1ed10e47-e2f4-4808-a6d0-4c6c8f745a8f tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865" status: 404 len: 111 microversion: 2.1 time: 0.032974 Feb 20 20:10:11.471293 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 399/809] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:11 2022] GET /compute/v2.1/servers/663894bf-b677-40cf-8c2f-db3bc1531865 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 20 20:10:11.482720 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-25faaa73-62ed-4e62-b1ef-937454d6526b tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:11.483209 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-25faaa73-62ed-4e62-b1ef-937454d6526b tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: bdff4760-c8ef-4f40-a118-40c44d576689] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:11.490355 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-25faaa73-62ed-4e62-b1ef-937454d6526b tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:11.490800 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-25faaa73-62ed-4e62-b1ef-937454d6526b tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:11.491593 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-25faaa73-62ed-4e62-b1ef-937454d6526b tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:11.492024 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-25faaa73-62ed-4e62-b1ef-937454d6526b tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:11.519190 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-25faaa73-62ed-4e62-b1ef-937454d6526b tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: bdff4760-c8ef-4f40-a118-40c44d576689] Going to try to terminate instance {{(pid=117087) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 20 20:10:11.557410 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a749d731-b994-4607-9d75-df52195c78af tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:11.565894 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a749d731-b994-4607-9d75-df52195c78af tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:11.567388 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a749d731-b994-4607-9d75-df52195c78af tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:11.568544 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a749d731-b994-4607-9d75-df52195c78af tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1723 microversion: 2.20 time: 0.173560 Feb 20 20:10:11.569130 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 411/810] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:11 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:11.875450 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-25faaa73-62ed-4e62-b1ef-937454d6526b tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689" status: 204 len: 0 microversion: 2.1 time: 0.395770 Feb 20 20:10:11.876234 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 400/811] 10.222.0.60 () {58 vars in 1238 bytes} [Sun Feb 20 20:10:11 2022] DELETE /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 20 20:10:11.884764 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6564a1ed-a841-4246-82e8-cbdfbf498c48 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:11.885452 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6564a1ed-a841-4246-82e8-cbdfbf498c48 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: bdff4760-c8ef-4f40-a118-40c44d576689] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:11.892675 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6564a1ed-a841-4246-82e8-cbdfbf498c48 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:11.893147 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6564a1ed-a841-4246-82e8-cbdfbf498c48 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:11.893940 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6564a1ed-a841-4246-82e8-cbdfbf498c48 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:11.894406 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6564a1ed-a841-4246-82e8-cbdfbf498c48 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:12.040338 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6564a1ed-a841-4246-82e8-cbdfbf498c48 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:12.048184 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6564a1ed-a841-4246-82e8-cbdfbf498c48 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689" status: 200 len: 1514 microversion: 2.1 time: 0.167229 Feb 20 20:10:12.048843 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 412/812] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:11 2022] GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:10:12.594537 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7f044587-b839-40d3-82f8-5833c82d43d8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:12.594537 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7f044587-b839-40d3-82f8-5833c82d43d8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:12.602562 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7f044587-b839-40d3-82f8-5833c82d43d8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:12.602562 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7f044587-b839-40d3-82f8-5833c82d43d8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:12.602562 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7f044587-b839-40d3-82f8-5833c82d43d8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:12.602562 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7f044587-b839-40d3-82f8-5833c82d43d8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:12.749738 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7f044587-b839-40d3-82f8-5833c82d43d8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:12.757736 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7f044587-b839-40d3-82f8-5833c82d43d8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:12.759227 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7f044587-b839-40d3-82f8-5833c82d43d8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:12.760410 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7f044587-b839-40d3-82f8-5833c82d43d8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1723 microversion: 2.20 time: 0.171207 Feb 20 20:10:12.760971 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 401/813] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:12 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:13.064754 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c70e43ae-575a-4b2a-a3c6-e1fd5e167875 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:13.065387 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c70e43ae-575a-4b2a-a3c6-e1fd5e167875 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: bdff4760-c8ef-4f40-a118-40c44d576689] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:13.072027 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c70e43ae-575a-4b2a-a3c6-e1fd5e167875 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:13.072478 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c70e43ae-575a-4b2a-a3c6-e1fd5e167875 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:13.073294 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c70e43ae-575a-4b2a-a3c6-e1fd5e167875 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:13.073734 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c70e43ae-575a-4b2a-a3c6-e1fd5e167875 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:13.214041 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c70e43ae-575a-4b2a-a3c6-e1fd5e167875 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:13.222065 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c70e43ae-575a-4b2a-a3c6-e1fd5e167875 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689" status: 200 len: 1514 microversion: 2.1 time: 0.161066 Feb 20 20:10:13.222707 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 413/814] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:13 2022] GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:13.778608 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-608cc3d7-fa2d-4bc7-8eb8-93349574494f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:13.779214 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-608cc3d7-fa2d-4bc7-8eb8-93349574494f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:13.786065 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-608cc3d7-fa2d-4bc7-8eb8-93349574494f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:13.786554 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-608cc3d7-fa2d-4bc7-8eb8-93349574494f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:13.787475 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-608cc3d7-fa2d-4bc7-8eb8-93349574494f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:13.787945 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-608cc3d7-fa2d-4bc7-8eb8-93349574494f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:14.013009 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-608cc3d7-fa2d-4bc7-8eb8-93349574494f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:14.020923 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-608cc3d7-fa2d-4bc7-8eb8-93349574494f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:14.022509 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-608cc3d7-fa2d-4bc7-8eb8-93349574494f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:14.023694 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-608cc3d7-fa2d-4bc7-8eb8-93349574494f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1723 microversion: 2.20 time: 0.248879 Feb 20 20:10:14.024259 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 402/815] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:13 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:14.241454 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-30e068d7-b4e4-44a1-a913-07ca40352b14 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:14.242061 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-30e068d7-b4e4-44a1-a913-07ca40352b14 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: bdff4760-c8ef-4f40-a118-40c44d576689] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:14.248731 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-30e068d7-b4e4-44a1-a913-07ca40352b14 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:14.249207 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-30e068d7-b4e4-44a1-a913-07ca40352b14 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:14.249997 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-30e068d7-b4e4-44a1-a913-07ca40352b14 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:14.250428 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-30e068d7-b4e4-44a1-a913-07ca40352b14 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:14.330723 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-30e068d7-b4e4-44a1-a913-07ca40352b14 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:14.339286 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-30e068d7-b4e4-44a1-a913-07ca40352b14 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689" status: 200 len: 1472 microversion: 2.1 time: 0.102113 Feb 20 20:10:14.346370 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 414/816] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:14 2022] GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689 => generated 1472 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:14.359299 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-f43c414c-6999-44e7-bb2e-204cce40ee65 req-21d0160f-ea6f-4ee1-8d4f-9096373602fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdff4760-c8ef-4f40-a118-40c44d576689", "name": "network-vif-deleted", "tag": "e80e85e5-c807-440e-b552-b5406cb0afa7"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:10:14.360841 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:10:14.360841 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:10:14.372682 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-f43c414c-6999-44e7-bb2e-204cce40ee65 req-21d0160f-ea6f-4ee1-8d4f-9096373602fe service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:14.373142 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-f43c414c-6999-44e7-bb2e-204cce40ee65 req-21d0160f-ea6f-4ee1-8d4f-9096373602fe service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:14.385905 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-f43c414c-6999-44e7-bb2e-204cce40ee65 req-21d0160f-ea6f-4ee1-8d4f-9096373602fe service nova] Creating event network-vif-deleted:e80e85e5-c807-440e-b552-b5406cb0afa7 for instance bdff4760-c8ef-4f40-a118-40c44d576689 on hv-cinder-83008 Feb 20 20:10:14.391041 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-f43c414c-6999-44e7-bb2e-204cce40ee65 req-21d0160f-ea6f-4ee1-8d4f-9096373602fe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035445 Feb 20 20:10:14.392077 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 403/817] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:10:15.041997 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d74ee7be-6cbe-4e0b-8f97-58e51890ce07 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:15.042606 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d74ee7be-6cbe-4e0b-8f97-58e51890ce07 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:15.048800 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d74ee7be-6cbe-4e0b-8f97-58e51890ce07 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:15.049296 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d74ee7be-6cbe-4e0b-8f97-58e51890ce07 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:15.050130 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d74ee7be-6cbe-4e0b-8f97-58e51890ce07 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:15.050568 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d74ee7be-6cbe-4e0b-8f97-58e51890ce07 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:15.191433 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d74ee7be-6cbe-4e0b-8f97-58e51890ce07 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:15.200586 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d74ee7be-6cbe-4e0b-8f97-58e51890ce07 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:15.204727 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d74ee7be-6cbe-4e0b-8f97-58e51890ce07 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:15.204727 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d74ee7be-6cbe-4e0b-8f97-58e51890ce07 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1723 microversion: 2.20 time: 0.165420 Feb 20 20:10:15.204727 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 415/818] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:15 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:10:15.358423 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-92e4fd47-ad11-4d47-a49a-b07d416ef708 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:15.359029 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-92e4fd47-ad11-4d47-a49a-b07d416ef708 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: bdff4760-c8ef-4f40-a118-40c44d576689] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:15.366276 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92e4fd47-ad11-4d47-a49a-b07d416ef708 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:15.366685 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92e4fd47-ad11-4d47-a49a-b07d416ef708 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:15.367464 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92e4fd47-ad11-4d47-a49a-b07d416ef708 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:15.370706 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92e4fd47-ad11-4d47-a49a-b07d416ef708 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:15.401386 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92e4fd47-ad11-4d47-a49a-b07d416ef708 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:15.401828 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-92e4fd47-ad11-4d47-a49a-b07d416ef708 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:15.402271 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-92e4fd47-ad11-4d47-a49a-b07d416ef708 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lazy-loading 'fault' on Instance uuid bdff4760-c8ef-4f40-a118-40c44d576689 {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:10:15.446305 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-92e4fd47-ad11-4d47-a49a-b07d416ef708 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:15.454057 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-92e4fd47-ad11-4d47-a49a-b07d416ef708 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689" status: 200 len: 1307 microversion: 2.1 time: 0.100569 Feb 20 20:10:15.454707 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 404/819] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:15 2022] GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689 => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:16.222823 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-106bf3e8-c884-4bcc-be99-f3959c6d70c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:16.223514 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-106bf3e8-c884-4bcc-be99-f3959c6d70c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:16.230740 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-106bf3e8-c884-4bcc-be99-f3959c6d70c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:16.231184 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-106bf3e8-c884-4bcc-be99-f3959c6d70c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:16.231979 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-106bf3e8-c884-4bcc-be99-f3959c6d70c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:16.232409 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-106bf3e8-c884-4bcc-be99-f3959c6d70c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:16.387903 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-106bf3e8-c884-4bcc-be99-f3959c6d70c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:16.397047 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-106bf3e8-c884-4bcc-be99-f3959c6d70c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:16.398603 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-106bf3e8-c884-4bcc-be99-f3959c6d70c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:16.399838 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-106bf3e8-c884-4bcc-be99-f3959c6d70c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1723 microversion: 2.20 time: 0.181045 Feb 20 20:10:16.400408 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 416/820] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:16 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:16.472800 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e83d5c3f-78d7-45a1-b797-11f1543d74a9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:16.474089 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e83d5c3f-78d7-45a1-b797-11f1543d74a9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: bdff4760-c8ef-4f40-a118-40c44d576689] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:16.480552 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e83d5c3f-78d7-45a1-b797-11f1543d74a9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:16.481003 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e83d5c3f-78d7-45a1-b797-11f1543d74a9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:16.481817 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e83d5c3f-78d7-45a1-b797-11f1543d74a9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:16.482244 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e83d5c3f-78d7-45a1-b797-11f1543d74a9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:16.496665 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-e83d5c3f-78d7-45a1-b797-11f1543d74a9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] HTTP exception thrown: Instance bdff4760-c8ef-4f40-a118-40c44d576689 could not be found. Feb 20 20:10:16.497274 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e83d5c3f-78d7-45a1-b797-11f1543d74a9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Returning 404 to user: Instance bdff4760-c8ef-4f40-a118-40c44d576689 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:10:16.498093 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e83d5c3f-78d7-45a1-b797-11f1543d74a9 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689" status: 404 len: 111 microversion: 2.1 time: 0.029627 Feb 20 20:10:16.498632 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 405/821] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:16 2022] GET /compute/v2.1/servers/bdff4760-c8ef-4f40-a118-40c44d576689 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:10:16.925199 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-953c0771-5b47-4e07-a2f3-de64b3b6ec89 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:16.925690 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-953c0771-5b47-4e07-a2f3-de64b3b6ec89 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:16.932056 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-953c0771-5b47-4e07-a2f3-de64b3b6ec89 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:16.932497 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-953c0771-5b47-4e07-a2f3-de64b3b6ec89 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:16.933316 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-953c0771-5b47-4e07-a2f3-de64b3b6ec89 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:16.933747 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-953c0771-5b47-4e07-a2f3-de64b3b6ec89 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:16.966377 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-953c0771-5b47-4e07-a2f3-de64b3b6ec89 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/os-volume_attachments/db86aa63-dc50-429d-b628-fcd766b91c83" status: 200 len: 194 microversion: 2.1 time: 0.044997 Feb 20 20:10:16.966996 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 417/822] 10.222.0.60 () {58 vars in 1412 bytes} [Sun Feb 20 20:10:16 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/os-volume_attachments/db86aa63-dc50-429d-b628-fcd766b91c83 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:10:16.978236 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f44981f4-55ad-4d1b-8a73-63c996c9b4e8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:16.978641 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f44981f4-55ad-4d1b-8a73-63c996c9b4e8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:16.985224 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f44981f4-55ad-4d1b-8a73-63c996c9b4e8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:16.985672 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f44981f4-55ad-4d1b-8a73-63c996c9b4e8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:16.986512 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f44981f4-55ad-4d1b-8a73-63c996c9b4e8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:16.986990 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f44981f4-55ad-4d1b-8a73-63c996c9b4e8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:17.072406 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-f44981f4-55ad-4d1b-8a73-63c996c9b4e8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lazy-loading 'services' on Instance uuid 34811e5b-3079-49d9-8b1f-5e3284872e21 {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:10:17.400991 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f44981f4-55ad-4d1b-8a73-63c996c9b4e8 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "DELETE /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/os-volume_attachments/db86aa63-dc50-429d-b628-fcd766b91c83" status: 202 len: 0 microversion: 2.1 time: 0.427662 Feb 20 20:10:17.402246 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 406/823] 10.222.0.60 () {58 vars in 1415 bytes} [Sun Feb 20 20:10:16 2022] DELETE /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/os-volume_attachments/db86aa63-dc50-429d-b628-fcd766b91c83 => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:10:17.422469 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8d1acea1-5f6e-4d5f-90ed-d4aeda7e8eab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:17.425678 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8d1acea1-5f6e-4d5f-90ed-d4aeda7e8eab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:17.437377 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8d1acea1-5f6e-4d5f-90ed-d4aeda7e8eab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:17.438359 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8d1acea1-5f6e-4d5f-90ed-d4aeda7e8eab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:17.439832 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8d1acea1-5f6e-4d5f-90ed-d4aeda7e8eab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:17.440449 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8d1acea1-5f6e-4d5f-90ed-d4aeda7e8eab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:17.685402 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8d1acea1-5f6e-4d5f-90ed-d4aeda7e8eab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:17.693921 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8d1acea1-5f6e-4d5f-90ed-d4aeda7e8eab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:17.695425 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8d1acea1-5f6e-4d5f-90ed-d4aeda7e8eab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:17.697006 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8d1acea1-5f6e-4d5f-90ed-d4aeda7e8eab tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1723 microversion: 2.20 time: 0.281797 Feb 20 20:10:17.697589 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 418/824] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:17 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:17.802774 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b714e6ac-000f-40e1-a83f-125a8e0e2496 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:17.803565 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b714e6ac-000f-40e1-a83f-125a8e0e2496 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:17.810900 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b714e6ac-000f-40e1-a83f-125a8e0e2496 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:17.811491 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b714e6ac-000f-40e1-a83f-125a8e0e2496 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:17.812897 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b714e6ac-000f-40e1-a83f-125a8e0e2496 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:17.813721 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b714e6ac-000f-40e1-a83f-125a8e0e2496 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:17.845317 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b714e6ac-000f-40e1-a83f-125a8e0e2496 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Going to try to terminate instance {{(pid=117087) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 20 20:10:18.205352 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b714e6ac-000f-40e1-a83f-125a8e0e2496 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403" status: 204 len: 0 microversion: 2.1 time: 0.406953 Feb 20 20:10:18.205972 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 407/825] 10.222.0.60 () {58 vars in 1238 bytes} [Sun Feb 20 20:10:17 2022] DELETE /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 20 20:10:18.214698 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-21e90611-ba59-4367-87dd-9b7e2290d3a1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:18.215451 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-21e90611-ba59-4367-87dd-9b7e2290d3a1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:18.221878 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-21e90611-ba59-4367-87dd-9b7e2290d3a1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:18.222326 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-21e90611-ba59-4367-87dd-9b7e2290d3a1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:18.223114 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-21e90611-ba59-4367-87dd-9b7e2290d3a1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:18.223550 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-21e90611-ba59-4367-87dd-9b7e2290d3a1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:18.384150 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-21e90611-ba59-4367-87dd-9b7e2290d3a1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:18.392267 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-21e90611-ba59-4367-87dd-9b7e2290d3a1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403" status: 200 len: 1514 microversion: 2.1 time: 0.181349 Feb 20 20:10:18.392981 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 419/826] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:18 2022] GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:18.719002 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-79d325e3-93a1-4e65-b245-82538e61f074 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:18.719694 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-79d325e3-93a1-4e65-b245-82538e61f074 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:18.726414 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-79d325e3-93a1-4e65-b245-82538e61f074 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:18.726846 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-79d325e3-93a1-4e65-b245-82538e61f074 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:18.727622 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-79d325e3-93a1-4e65-b245-82538e61f074 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:18.728050 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-79d325e3-93a1-4e65-b245-82538e61f074 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:18.870416 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-79d325e3-93a1-4e65-b245-82538e61f074 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:18.878759 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-79d325e3-93a1-4e65-b245-82538e61f074 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:18.880790 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-79d325e3-93a1-4e65-b245-82538e61f074 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:18.881975 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-79d325e3-93a1-4e65-b245-82538e61f074 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1723 microversion: 2.20 time: 0.167147 Feb 20 20:10:18.882545 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 408/827] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:18 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:10:19.409411 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a8573e36-4493-4134-b7d2-9c9b8ed8fb2c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:19.410099 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a8573e36-4493-4134-b7d2-9c9b8ed8fb2c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:19.416587 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a8573e36-4493-4134-b7d2-9c9b8ed8fb2c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:19.417023 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a8573e36-4493-4134-b7d2-9c9b8ed8fb2c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:19.417850 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a8573e36-4493-4134-b7d2-9c9b8ed8fb2c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:19.418276 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a8573e36-4493-4134-b7d2-9c9b8ed8fb2c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:19.570211 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a8573e36-4493-4134-b7d2-9c9b8ed8fb2c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:19.578464 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a8573e36-4493-4134-b7d2-9c9b8ed8fb2c tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403" status: 200 len: 1514 microversion: 2.1 time: 0.172637 Feb 20 20:10:19.579520 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 420/828] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:19 2022] GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:19.588708 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6572d045-9f65-438d-9986-c611b97d3907 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:19.589395 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6572d045-9f65-438d-9986-c611b97d3907 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:19.596280 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6572d045-9f65-438d-9986-c611b97d3907 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:19.596727 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6572d045-9f65-438d-9986-c611b97d3907 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:19.597565 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6572d045-9f65-438d-9986-c611b97d3907 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:19.597995 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6572d045-9f65-438d-9986-c611b97d3907 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:19.633785 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6572d045-9f65-438d-9986-c611b97d3907 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/os-volume_attachments/d2260f38-7187-4340-aa46-a66299f1d28d" status: 200 len: 194 microversion: 2.1 time: 0.048756 Feb 20 20:10:19.634653 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 409/829] 10.222.0.60 () {58 vars in 1412 bytes} [Sun Feb 20 20:10:19 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/os-volume_attachments/d2260f38-7187-4340-aa46-a66299f1d28d => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:10:19.644669 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-99c9ecff-2fb3-4a51-9b30-38a3c1864866 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:19.645187 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-99c9ecff-2fb3-4a51-9b30-38a3c1864866 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:19.652142 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-99c9ecff-2fb3-4a51-9b30-38a3c1864866 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:19.652584 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-99c9ecff-2fb3-4a51-9b30-38a3c1864866 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:19.653403 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-99c9ecff-2fb3-4a51-9b30-38a3c1864866 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:19.653836 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-99c9ecff-2fb3-4a51-9b30-38a3c1864866 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:19.735851 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-99c9ecff-2fb3-4a51-9b30-38a3c1864866 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lazy-loading 'services' on Instance uuid 34811e5b-3079-49d9-8b1f-5e3284872e21 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:10:19.901284 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-330fb3eb-323e-47a1-9c3a-3c17f281f401 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:19.902137 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-330fb3eb-323e-47a1-9c3a-3c17f281f401 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:19.908714 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-330fb3eb-323e-47a1-9c3a-3c17f281f401 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:19.909358 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-330fb3eb-323e-47a1-9c3a-3c17f281f401 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:19.910169 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-330fb3eb-323e-47a1-9c3a-3c17f281f401 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:19.910606 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-330fb3eb-323e-47a1-9c3a-3c17f281f401 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:19.965275 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-99c9ecff-2fb3-4a51-9b30-38a3c1864866 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "DELETE /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/os-volume_attachments/d2260f38-7187-4340-aa46-a66299f1d28d" status: 202 len: 0 microversion: 2.1 time: 0.323156 Feb 20 20:10:19.965972 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 421/830] 10.222.0.60 () {58 vars in 1415 bytes} [Sun Feb 20 20:10:19 2022] DELETE /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/os-volume_attachments/d2260f38-7187-4340-aa46-a66299f1d28d => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:10:20.078874 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-330fb3eb-323e-47a1-9c3a-3c17f281f401 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:20.088952 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-330fb3eb-323e-47a1-9c3a-3c17f281f401 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:20.090576 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-330fb3eb-323e-47a1-9c3a-3c17f281f401 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:20.092416 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-330fb3eb-323e-47a1-9c3a-3c17f281f401 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1723 microversion: 2.20 time: 0.195000 Feb 20 20:10:20.092990 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 410/831] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:19 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:10:20.600604 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2e150fb5-a999-4ac8-aa0e-155485db6457 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:20.601344 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2e150fb5-a999-4ac8-aa0e-155485db6457 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:20.608197 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2e150fb5-a999-4ac8-aa0e-155485db6457 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:20.608631 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2e150fb5-a999-4ac8-aa0e-155485db6457 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:20.609462 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2e150fb5-a999-4ac8-aa0e-155485db6457 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:20.609920 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2e150fb5-a999-4ac8-aa0e-155485db6457 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:20.849712 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-bef2bc56-678a-4ce0-bdcd-80a9026ff70b req-3da260da-97d0-4537-830f-a93a1fa86f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c24fc5e6-53c6-422a-b7f3-66a6cb6d5403", "name": "network-vif-deleted", "tag": "d872fe09-a9ab-4392-ac8e-1421bc217d95"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:10:20.852925 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:10:20.852925 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:10:20.866720 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2e150fb5-a999-4ac8-aa0e-155485db6457 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:20.866922 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-bef2bc56-678a-4ce0-bdcd-80a9026ff70b req-3da260da-97d0-4537-830f-a93a1fa86f53 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:20.866922 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-bef2bc56-678a-4ce0-bdcd-80a9026ff70b req-3da260da-97d0-4537-830f-a93a1fa86f53 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:20.875231 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2e150fb5-a999-4ac8-aa0e-155485db6457 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403" status: 200 len: 1514 microversion: 2.1 time: 0.280644 Feb 20 20:10:20.880338 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-bef2bc56-678a-4ce0-bdcd-80a9026ff70b req-3da260da-97d0-4537-830f-a93a1fa86f53 service nova] Creating event network-vif-deleted:d872fe09-a9ab-4392-ac8e-1421bc217d95 for instance c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 on hv-cinder-83008 Feb 20 20:10:20.885841 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-bef2bc56-678a-4ce0-bdcd-80a9026ff70b req-3da260da-97d0-4537-830f-a93a1fa86f53 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043445 Feb 20 20:10:20.886222 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 422/832] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:20 2022] GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 => generated 1514 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:20.886477 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 411/833] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:10:21.111847 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-dc7484d7-b11c-460f-ba3a-5bd53e0f63fb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:21.112572 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-dc7484d7-b11c-460f-ba3a-5bd53e0f63fb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:21.126191 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dc7484d7-b11c-460f-ba3a-5bd53e0f63fb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:21.126786 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dc7484d7-b11c-460f-ba3a-5bd53e0f63fb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:21.127643 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dc7484d7-b11c-460f-ba3a-5bd53e0f63fb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:21.128192 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dc7484d7-b11c-460f-ba3a-5bd53e0f63fb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:21.282863 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-dc7484d7-b11c-460f-ba3a-5bd53e0f63fb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:21.292654 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-dc7484d7-b11c-460f-ba3a-5bd53e0f63fb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:21.294455 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-dc7484d7-b11c-460f-ba3a-5bd53e0f63fb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:21.295676 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-dc7484d7-b11c-460f-ba3a-5bd53e0f63fb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1744 microversion: 2.20 time: 0.187673 Feb 20 20:10:21.296257 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 423/834] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:21 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1744 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:21.894083 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d832a44a-bba2-4038-a17b-1d6fba413cd1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:21.894689 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d832a44a-bba2-4038-a17b-1d6fba413cd1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:21.901676 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d832a44a-bba2-4038-a17b-1d6fba413cd1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:21.902115 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d832a44a-bba2-4038-a17b-1d6fba413cd1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:21.910643 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d832a44a-bba2-4038-a17b-1d6fba413cd1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:21.910643 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d832a44a-bba2-4038-a17b-1d6fba413cd1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:21.936222 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d832a44a-bba2-4038-a17b-1d6fba413cd1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:21.936668 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d832a44a-bba2-4038-a17b-1d6fba413cd1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:21.937136 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-d832a44a-bba2-4038-a17b-1d6fba413cd1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lazy-loading 'fault' on Instance uuid c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:10:21.981366 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d832a44a-bba2-4038-a17b-1d6fba413cd1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c74b25bf2e94447ab74a7e157eadac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79884d2db8f34ea3a56bb24700c0834b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:21.989591 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d832a44a-bba2-4038-a17b-1d6fba413cd1 tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403" status: 200 len: 1308 microversion: 2.1 time: 0.099650 Feb 20 20:10:21.990678 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 412/835] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:21 2022] GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:22.211659 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-01e756be-6e65-43ab-b0bd-9d152006aa3e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:22.212635 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-01e756be-6e65-43ab-b0bd-9d152006aa3e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:22.219080 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-01e756be-6e65-43ab-b0bd-9d152006aa3e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:22.219560 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-01e756be-6e65-43ab-b0bd-9d152006aa3e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:22.221734 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-01e756be-6e65-43ab-b0bd-9d152006aa3e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:22.221734 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-01e756be-6e65-43ab-b0bd-9d152006aa3e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:22.252067 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-01e756be-6e65-43ab-b0bd-9d152006aa3e tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044767 Feb 20 20:10:22.252631 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 424/836] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:10:22 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 20 20:10:22.321469 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-664a64a1-edf3-4e54-a8fc-5ca97a9f37b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:22.322128 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-664a64a1-edf3-4e54-a8fc-5ca97a9f37b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:22.328115 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-664a64a1-edf3-4e54-a8fc-5ca97a9f37b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:22.328640 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-664a64a1-edf3-4e54-a8fc-5ca97a9f37b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:22.329458 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-664a64a1-edf3-4e54-a8fc-5ca97a9f37b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:22.329990 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-664a64a1-edf3-4e54-a8fc-5ca97a9f37b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:22.361228 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8034a09a-df67-48d3-bbef-d34395d4b7c3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:22.361817 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8034a09a-df67-48d3-bbef-d34395d4b7c3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:22.368644 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8034a09a-df67-48d3-bbef-d34395d4b7c3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:22.369087 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8034a09a-df67-48d3-bbef-d34395d4b7c3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:22.369887 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8034a09a-df67-48d3-bbef-d34395d4b7c3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:22.370312 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8034a09a-df67-48d3-bbef-d34395d4b7c3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:22.399389 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8034a09a-df67-48d3-bbef-d34395d4b7c3 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042174 Feb 20 20:10:22.400333 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 425/837] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:10:22 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 20 20:10:22.458296 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d8f6c1b9-b817-4402-94c1-766bb51b3aea tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:22.458791 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d8f6c1b9-b817-4402-94c1-766bb51b3aea tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:22.464532 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d8f6c1b9-b817-4402-94c1-766bb51b3aea tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:22.464985 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d8f6c1b9-b817-4402-94c1-766bb51b3aea tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:22.465797 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d8f6c1b9-b817-4402-94c1-766bb51b3aea tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:22.466233 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d8f6c1b9-b817-4402-94c1-766bb51b3aea tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:22.480855 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-664a64a1-edf3-4e54-a8fc-5ca97a9f37b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:22.489937 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-664a64a1-edf3-4e54-a8fc-5ca97a9f37b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:22.491648 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-664a64a1-edf3-4e54-a8fc-5ca97a9f37b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:22.492894 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-664a64a1-edf3-4e54-a8fc-5ca97a9f37b5 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1744 microversion: 2.20 time: 0.177780 Feb 20 20:10:22.493662 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 413/838] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:22 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:22.493901 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d8f6c1b9-b817-4402-94c1-766bb51b3aea tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 20 20:10:22.711874 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d8f6c1b9-b817-4402-94c1-766bb51b3aea tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "DELETE /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 204 len: 0 microversion: 2.1 time: 0.256326 Feb 20 20:10:22.712968 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 426/839] 10.222.0.60 () {58 vars in 1238 bytes} [Sun Feb 20 20:10:22 2022] DELETE /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 20 20:10:22.722771 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9fac1994-545f-4987-b1a9-b98d11f8a5b6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:22.724200 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9fac1994-545f-4987-b1a9-b98d11f8a5b6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:22.731112 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9fac1994-545f-4987-b1a9-b98d11f8a5b6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:22.731911 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9fac1994-545f-4987-b1a9-b98d11f8a5b6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:22.732419 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9fac1994-545f-4987-b1a9-b98d11f8a5b6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:22.732831 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9fac1994-545f-4987-b1a9-b98d11f8a5b6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:22.879699 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-9fac1994-545f-4987-b1a9-b98d11f8a5b6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:22.887649 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9fac1994-545f-4987-b1a9-b98d11f8a5b6 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 200 len: 1673 microversion: 2.1 time: 0.168800 Feb 20 20:10:22.888226 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 414/840] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:22 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:10:23.008271 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-68417bbf-5654-4cd4-8cba-438a7d6d53fc tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:23.009006 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-68417bbf-5654-4cd4-8cba-438a7d6d53fc tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] [instance: c24fc5e6-53c6-422a-b7f3-66a6cb6d5403] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:23.014789 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-68417bbf-5654-4cd4-8cba-438a7d6d53fc tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:23.015205 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-68417bbf-5654-4cd4-8cba-438a7d6d53fc tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:23.015975 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-68417bbf-5654-4cd4-8cba-438a7d6d53fc tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:23.016409 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-68417bbf-5654-4cd4-8cba-438a7d6d53fc tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:23.032666 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-68417bbf-5654-4cd4-8cba-438a7d6d53fc tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] HTTP exception thrown: Instance c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 could not be found. Feb 20 20:10:23.033291 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-68417bbf-5654-4cd4-8cba-438a7d6d53fc tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] Returning 404 to user: Instance c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:10:23.034116 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-68417bbf-5654-4cd4-8cba-438a7d6d53fc tempest-AttachVolumeNegativeTest-1644093707 tempest-AttachVolumeNegativeTest-1644093707-project] 10.222.0.60 "GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403" status: 404 len: 111 microversion: 2.1 time: 0.030576 Feb 20 20:10:23.034681 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 427/841] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:23 2022] GET /compute/v2.1/servers/c24fc5e6-53c6-422a-b7f3-66a6cb6d5403 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:10:23.511990 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a6cb78d8-6a5f-4e25-b0ac-be5a91192a02 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:23.512603 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a6cb78d8-6a5f-4e25-b0ac-be5a91192a02 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:23.519384 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a6cb78d8-6a5f-4e25-b0ac-be5a91192a02 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:23.519909 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a6cb78d8-6a5f-4e25-b0ac-be5a91192a02 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:23.521365 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a6cb78d8-6a5f-4e25-b0ac-be5a91192a02 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:23.521887 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a6cb78d8-6a5f-4e25-b0ac-be5a91192a02 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:23.748324 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a6cb78d8-6a5f-4e25-b0ac-be5a91192a02 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:23.757564 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a6cb78d8-6a5f-4e25-b0ac-be5a91192a02 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:23.759383 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-a6cb78d8-6a5f-4e25-b0ac-be5a91192a02 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:23.760543 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a6cb78d8-6a5f-4e25-b0ac-be5a91192a02 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1739 microversion: 2.20 time: 0.252481 Feb 20 20:10:23.773311 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 415/842] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:23 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1739 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:23.906048 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2a9e2eb3-e87b-4a28-b3ae-cc724b9c4a65 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:23.906683 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2a9e2eb3-e87b-4a28-b3ae-cc724b9c4a65 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:23.913523 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2a9e2eb3-e87b-4a28-b3ae-cc724b9c4a65 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:23.916735 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2a9e2eb3-e87b-4a28-b3ae-cc724b9c4a65 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:23.916735 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2a9e2eb3-e87b-4a28-b3ae-cc724b9c4a65 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:23.916735 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2a9e2eb3-e87b-4a28-b3ae-cc724b9c4a65 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:24.071934 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2a9e2eb3-e87b-4a28-b3ae-cc724b9c4a65 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:24.077957 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2a9e2eb3-e87b-4a28-b3ae-cc724b9c4a65 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 200 len: 1673 microversion: 2.1 time: 0.175616 Feb 20 20:10:24.078526 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 428/843] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:23 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:10:24.780785 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f5239fb2-1a4b-45e4-97f1-1086f47a77e0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:24.782164 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f5239fb2-1a4b-45e4-97f1-1086f47a77e0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:24.791917 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f5239fb2-1a4b-45e4-97f1-1086f47a77e0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:24.797309 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f5239fb2-1a4b-45e4-97f1-1086f47a77e0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:24.798158 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f5239fb2-1a4b-45e4-97f1-1086f47a77e0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:24.798596 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f5239fb2-1a4b-45e4-97f1-1086f47a77e0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:25.047853 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-a9e025ae-726f-450b-9945-77133f9cf584 req-06d9193b-d93d-4edd-8515-7670e8eac7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f60f31-e3e4-4705-910a-d01bdba1d965", "name": "network-vif-plugged", "status": "completed", "tag": "1a899be1-fae4-4e55-ab37-e5b2c436daf0"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:10:25.049712 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f5239fb2-1a4b-45e4-97f1-1086f47a77e0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:25.050287 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:10:25.050287 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:10:25.060527 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f5239fb2-1a4b-45e4-97f1-1086f47a77e0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:25.061445 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-a9e025ae-726f-450b-9945-77133f9cf584 req-06d9193b-d93d-4edd-8515-7670e8eac7e7 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:25.062399 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-a9e025ae-726f-450b-9945-77133f9cf584 req-06d9193b-d93d-4edd-8515-7670e8eac7e7 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:25.063785 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f5239fb2-1a4b-45e4-97f1-1086f47a77e0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:25.065422 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f5239fb2-1a4b-45e4-97f1-1086f47a77e0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1739 microversion: 2.20 time: 0.287959 Feb 20 20:10:25.067864 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 416/844] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:24 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1739 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:25.078579 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-a9e025ae-726f-450b-9945-77133f9cf584 req-06d9193b-d93d-4edd-8515-7670e8eac7e7 service nova] Creating event network-vif-plugged:1a899be1-fae4-4e55-ab37-e5b2c436daf0 for instance d2f60f31-e3e4-4705-910a-d01bdba1d965 on hv-cinder-83008 Feb 20 20:10:25.087486 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-a9e025ae-726f-450b-9945-77133f9cf584 req-06d9193b-d93d-4edd-8515-7670e8eac7e7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045070 Feb 20 20:10:25.088626 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 429/845] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:10:25.105333 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-fd322793-baa1-4708-bc9a-18181a7af1cb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:25.106564 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-fd322793-baa1-4708-bc9a-18181a7af1cb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:25.115200 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fd322793-baa1-4708-bc9a-18181a7af1cb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:25.116489 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fd322793-baa1-4708-bc9a-18181a7af1cb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:25.117510 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fd322793-baa1-4708-bc9a-18181a7af1cb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:25.117956 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fd322793-baa1-4708-bc9a-18181a7af1cb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:25.298884 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-fd322793-baa1-4708-bc9a-18181a7af1cb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:25.308305 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-fd322793-baa1-4708-bc9a-18181a7af1cb tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 200 len: 1673 microversion: 2.1 time: 0.206810 Feb 20 20:10:25.311048 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 417/846] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:25 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 1673 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:26.090173 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3f12a3b6-00ec-45a3-8901-cc6d8e915009 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:26.091037 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-3f12a3b6-00ec-45a3-8901-cc6d8e915009 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:26.123717 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3f12a3b6-00ec-45a3-8901-cc6d8e915009 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:26.124509 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3f12a3b6-00ec-45a3-8901-cc6d8e915009 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:26.125926 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3f12a3b6-00ec-45a3-8901-cc6d8e915009 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:26.126688 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3f12a3b6-00ec-45a3-8901-cc6d8e915009 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:26.331360 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5f7c4c0e-71eb-4beb-b43e-2c3d7d0169cd tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:26.333276 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5f7c4c0e-71eb-4beb-b43e-2c3d7d0169cd tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:26.340461 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5f7c4c0e-71eb-4beb-b43e-2c3d7d0169cd tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:26.346311 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5f7c4c0e-71eb-4beb-b43e-2c3d7d0169cd tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:26.346311 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5f7c4c0e-71eb-4beb-b43e-2c3d7d0169cd tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:26.346311 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5f7c4c0e-71eb-4beb-b43e-2c3d7d0169cd tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:26.745996 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5f7c4c0e-71eb-4beb-b43e-2c3d7d0169cd tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:26.759109 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5f7c4c0e-71eb-4beb-b43e-2c3d7d0169cd tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 200 len: 1605 microversion: 2.1 time: 0.434183 Feb 20 20:10:26.759688 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 418/847] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:26 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 1605 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:26.888528 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3f12a3b6-00ec-45a3-8901-cc6d8e915009 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:26.901780 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3f12a3b6-00ec-45a3-8901-cc6d8e915009 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:26.905035 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3f12a3b6-00ec-45a3-8901-cc6d8e915009 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:26.906666 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-3f12a3b6-00ec-45a3-8901-cc6d8e915009 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1739 microversion: 2.20 time: 0.820725 Feb 20 20:10:26.908510 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 430/848] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:26 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1739 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:27.128232 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-646b4497-b5b9-4285-962c-3a000679ecb7 req-e6f0c218-6a91-4b1d-ac44-d031d483b0a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34811e5b-3079-49d9-8b1f-5e3284872e21", "name": "network-vif-deleted", "tag": "2fc382f7-754d-4b58-ae91-4ee69bef1fc1"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:10:27.133774 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:10:27.133774 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:10:27.163336 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-646b4497-b5b9-4285-962c-3a000679ecb7 req-e6f0c218-6a91-4b1d-ac44-d031d483b0a2 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:27.169597 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-646b4497-b5b9-4285-962c-3a000679ecb7 req-e6f0c218-6a91-4b1d-ac44-d031d483b0a2 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:27.211336 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-646b4497-b5b9-4285-962c-3a000679ecb7 req-e6f0c218-6a91-4b1d-ac44-d031d483b0a2 service nova] Creating event network-vif-deleted:2fc382f7-754d-4b58-ae91-4ee69bef1fc1 for instance 34811e5b-3079-49d9-8b1f-5e3284872e21 on hv-cinder-83008 Feb 20 20:10:27.232944 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-646b4497-b5b9-4285-962c-3a000679ecb7 req-e6f0c218-6a91-4b1d-ac44-d031d483b0a2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102313 Feb 20 20:10:27.234059 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 419/849] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:10:27.779145 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-aaff679b-4499-4ac0-8b37-0c07798544b2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:27.779910 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-aaff679b-4499-4ac0-8b37-0c07798544b2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:27.790312 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aaff679b-4499-4ac0-8b37-0c07798544b2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:27.790809 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aaff679b-4499-4ac0-8b37-0c07798544b2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:27.793389 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aaff679b-4499-4ac0-8b37-0c07798544b2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:27.793860 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aaff679b-4499-4ac0-8b37-0c07798544b2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:27.843446 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aaff679b-4499-4ac0-8b37-0c07798544b2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:27.843936 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aaff679b-4499-4ac0-8b37-0c07798544b2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:27.844426 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-aaff679b-4499-4ac0-8b37-0c07798544b2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lazy-loading 'fault' on Instance uuid 34811e5b-3079-49d9-8b1f-5e3284872e21 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:10:27.909127 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-aaff679b-4499-4ac0-8b37-0c07798544b2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa60c0b71ba54f37b0a45b330f9683c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dde5e056c34a6a9fdf78ab276c3fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:27.922265 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-aaff679b-4499-4ac0-8b37-0c07798544b2 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 200 len: 1327 microversion: 2.1 time: 0.148384 Feb 20 20:10:27.923242 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 431/850] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:27 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 1327 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:27.933072 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8829135f-7d1f-45ae-b798-c07837650153 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:27.934175 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8829135f-7d1f-45ae-b798-c07837650153 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:27.944764 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8829135f-7d1f-45ae-b798-c07837650153 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:27.945872 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8829135f-7d1f-45ae-b798-c07837650153 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:27.947251 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8829135f-7d1f-45ae-b798-c07837650153 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:27.947838 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8829135f-7d1f-45ae-b798-c07837650153 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:28.138435 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8829135f-7d1f-45ae-b798-c07837650153 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:28.150427 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8829135f-7d1f-45ae-b798-c07837650153 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:28.153203 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8829135f-7d1f-45ae-b798-c07837650153 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:28.154450 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8829135f-7d1f-45ae-b798-c07837650153 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1739 microversion: 2.20 time: 0.231208 Feb 20 20:10:28.154953 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 420/851] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:27 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:28.947075 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f9eb1809-3551-44be-b024-968b99c9d20a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:28.948344 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f9eb1809-3551-44be-b024-968b99c9d20a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:28.963060 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f9eb1809-3551-44be-b024-968b99c9d20a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:28.966112 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f9eb1809-3551-44be-b024-968b99c9d20a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:28.966112 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f9eb1809-3551-44be-b024-968b99c9d20a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:28.966112 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f9eb1809-3551-44be-b024-968b99c9d20a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:28.987549 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-f9eb1809-3551-44be-b024-968b99c9d20a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] HTTP exception thrown: Instance 34811e5b-3079-49d9-8b1f-5e3284872e21 could not be found. Feb 20 20:10:28.988448 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f9eb1809-3551-44be-b024-968b99c9d20a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Returning 404 to user: Instance 34811e5b-3079-49d9-8b1f-5e3284872e21 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:10:28.990472 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f9eb1809-3551-44be-b024-968b99c9d20a tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 404 len: 111 microversion: 2.1 time: 0.047806 Feb 20 20:10:28.992083 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 432/852] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:28 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 20 20:10:29.000993 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-001f9561-292e-497e-ae5b-064f84079ef7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '.version_select at 0x7fdd91424dc0>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:29.095816 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-001f9561-292e-497e-ae5b-064f84079ef7 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-202645246" status: 202 len: 0 microversion: 2.1 time: 0.097405 Feb 20 20:10:29.103318 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 421/853] 10.222.0.60 () {58 vars in 1217 bytes} [Sun Feb 20 20:10:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-202645246 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:10:29.173371 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3bb61940-8b24-4016-83bd-668715463380 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:29.174259 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-3bb61940-8b24-4016-83bd-668715463380 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:29.183077 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3bb61940-8b24-4016-83bd-668715463380 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:29.183510 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3bb61940-8b24-4016-83bd-668715463380 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:29.184627 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3bb61940-8b24-4016-83bd-668715463380 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:29.185350 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3bb61940-8b24-4016-83bd-668715463380 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:29.456600 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3bb61940-8b24-4016-83bd-668715463380 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:29.470759 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3bb61940-8b24-4016-83bd-668715463380 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:29.475571 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3bb61940-8b24-4016-83bd-668715463380 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:29.476972 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-3bb61940-8b24-4016-83bd-668715463380 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1739 microversion: 2.20 time: 0.307538 Feb 20 20:10:29.489226 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 433/854] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:29 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1739 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:10:30.510454 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7e8ec680-405c-4cba-a125-edc81f8d6be1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:30.511339 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7e8ec680-405c-4cba-a125-edc81f8d6be1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:30.521257 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7e8ec680-405c-4cba-a125-edc81f8d6be1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:30.522018 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7e8ec680-405c-4cba-a125-edc81f8d6be1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:30.523036 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7e8ec680-405c-4cba-a125-edc81f8d6be1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:30.523675 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7e8ec680-405c-4cba-a125-edc81f8d6be1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:30.775426 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7e8ec680-405c-4cba-a125-edc81f8d6be1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:30.788571 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7e8ec680-405c-4cba-a125-edc81f8d6be1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:30.790122 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7e8ec680-405c-4cba-a125-edc81f8d6be1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:30.791578 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7e8ec680-405c-4cba-a125-edc81f8d6be1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1739 microversion: 2.20 time: 0.285599 Feb 20 20:10:30.792701 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 422/855] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:30 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1739 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:31.816582 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5d3d4786-94c7-4a80-b8b2-b967be27d161 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:31.818344 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5d3d4786-94c7-4a80-b8b2-b967be27d161 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:31.826756 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5d3d4786-94c7-4a80-b8b2-b967be27d161 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:31.827323 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5d3d4786-94c7-4a80-b8b2-b967be27d161 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:31.829202 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5d3d4786-94c7-4a80-b8b2-b967be27d161 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:31.829202 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5d3d4786-94c7-4a80-b8b2-b967be27d161 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:32.138728 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5d3d4786-94c7-4a80-b8b2-b967be27d161 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:32.159358 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5d3d4786-94c7-4a80-b8b2-b967be27d161 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:32.165514 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5d3d4786-94c7-4a80-b8b2-b967be27d161 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:32.168850 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5d3d4786-94c7-4a80-b8b2-b967be27d161 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1739 microversion: 2.20 time: 0.356047 Feb 20 20:10:32.171742 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 434/856] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:31 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1739 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:33.097331 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4d46761f-60ef-4778-842c-181b72d5d625 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:33.098104 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4d46761f-60ef-4778-842c-181b72d5d625 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:33.105039 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4d46761f-60ef-4778-842c-181b72d5d625 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:33.105527 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4d46761f-60ef-4778-842c-181b72d5d625 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:33.106499 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4d46761f-60ef-4778-842c-181b72d5d625 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:33.106948 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4d46761f-60ef-4778-842c-181b72d5d625 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:33.125080 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-4d46761f-60ef-4778-842c-181b72d5d625 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] HTTP exception thrown: Instance 34811e5b-3079-49d9-8b1f-5e3284872e21 could not be found. Feb 20 20:10:33.125717 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4d46761f-60ef-4778-842c-181b72d5d625 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Returning 404 to user: Instance 34811e5b-3079-49d9-8b1f-5e3284872e21 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:10:33.126560 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4d46761f-60ef-4778-842c-181b72d5d625 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "DELETE /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 404 len: 111 microversion: 2.1 time: 0.033319 Feb 20 20:10:33.127141 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 423/857] 10.222.0.60 () {58 vars in 1238 bytes} [Sun Feb 20 20:10:33 2022] DELETE /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:10:33.138887 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a899a914-62d3-4af3-bbe7-90bd426327de tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:33.140280 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a899a914-62d3-4af3-bbe7-90bd426327de tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: 34811e5b-3079-49d9-8b1f-5e3284872e21] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:33.150095 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a899a914-62d3-4af3-bbe7-90bd426327de tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:33.152344 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a899a914-62d3-4af3-bbe7-90bd426327de tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:33.153058 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a899a914-62d3-4af3-bbe7-90bd426327de tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:33.154165 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a899a914-62d3-4af3-bbe7-90bd426327de tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:33.185804 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-a899a914-62d3-4af3-bbe7-90bd426327de tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] HTTP exception thrown: Instance 34811e5b-3079-49d9-8b1f-5e3284872e21 could not be found. Feb 20 20:10:33.186995 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a899a914-62d3-4af3-bbe7-90bd426327de tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Returning 404 to user: Instance 34811e5b-3079-49d9-8b1f-5e3284872e21 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:10:33.188253 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a899a914-62d3-4af3-bbe7-90bd426327de tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21" status: 404 len: 111 microversion: 2.1 time: 0.054053 Feb 20 20:10:33.189363 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 435/858] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:33 2022] GET /compute/v2.1/servers/34811e5b-3079-49d9-8b1f-5e3284872e21 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:10:33.200145 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8ec14a99-da21-46c6-b009-6a24c7b088e7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:33.200829 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8ec14a99-da21-46c6-b009-6a24c7b088e7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:33.225337 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8ec14a99-da21-46c6-b009-6a24c7b088e7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:33.226861 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8ec14a99-da21-46c6-b009-6a24c7b088e7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:33.229348 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8ec14a99-da21-46c6-b009-6a24c7b088e7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:33.234371 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8ec14a99-da21-46c6-b009-6a24c7b088e7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:33.519306 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8ec14a99-da21-46c6-b009-6a24c7b088e7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:33.531200 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8ec14a99-da21-46c6-b009-6a24c7b088e7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:33.532880 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8ec14a99-da21-46c6-b009-6a24c7b088e7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:33.534744 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8ec14a99-da21-46c6-b009-6a24c7b088e7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1739 microversion: 2.20 time: 0.343117 Feb 20 20:10:33.535168 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 424/859] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:33 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1739 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:34.506181 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5ae9c443-ea0a-4700-84d1-7c0001d0233b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:34.507502 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5ae9c443-ea0a-4700-84d1-7c0001d0233b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:34.514382 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5ae9c443-ea0a-4700-84d1-7c0001d0233b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:34.514883 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5ae9c443-ea0a-4700-84d1-7c0001d0233b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:34.515890 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5ae9c443-ea0a-4700-84d1-7c0001d0233b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:34.516332 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5ae9c443-ea0a-4700-84d1-7c0001d0233b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:34.533013 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-5ae9c443-ea0a-4700-84d1-7c0001d0233b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] HTTP exception thrown: Instance ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 could not be found. Feb 20 20:10:34.533641 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5ae9c443-ea0a-4700-84d1-7c0001d0233b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Returning 404 to user: Instance ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:10:34.534643 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5ae9c443-ea0a-4700-84d1-7c0001d0233b tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 404 len: 111 microversion: 2.1 time: 0.033627 Feb 20 20:10:34.544597 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9369b520-025b-4d30-ba81-5b65a3fbe667 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:34.545917 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9369b520-025b-4d30-ba81-5b65a3fbe667 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] [instance: ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:34.551790 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 436/860] 10.222.0.60 () {58 vars in 1238 bytes} [Sun Feb 20 20:10:34 2022] DELETE /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:10:34.559259 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-65766d10-bdfe-4662-bf01-67c0b21465d4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:34.559932 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9369b520-025b-4d30-ba81-5b65a3fbe667 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:34.560658 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9369b520-025b-4d30-ba81-5b65a3fbe667 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:34.561761 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9369b520-025b-4d30-ba81-5b65a3fbe667 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:34.562376 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9369b520-025b-4d30-ba81-5b65a3fbe667 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:34.563207 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-65766d10-bdfe-4662-bf01-67c0b21465d4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:34.581727 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-65766d10-bdfe-4662-bf01-67c0b21465d4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:34.583628 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-65766d10-bdfe-4662-bf01-67c0b21465d4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:34.584606 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-65766d10-bdfe-4662-bf01-67c0b21465d4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:34.585507 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-65766d10-bdfe-4662-bf01-67c0b21465d4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:34.596921 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-9369b520-025b-4d30-ba81-5b65a3fbe667 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] HTTP exception thrown: Instance ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 could not be found. Feb 20 20:10:34.601150 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9369b520-025b-4d30-ba81-5b65a3fbe667 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] Returning 404 to user: Instance ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:10:34.603397 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9369b520-025b-4d30-ba81-5b65a3fbe667 tempest-AttachVolumeTestJSON-1661002890 tempest-AttachVolumeTestJSON-1661002890-project] 10.222.0.60 "GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6" status: 404 len: 111 microversion: 2.1 time: 0.061508 Feb 20 20:10:34.603397 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 425/861] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:34 2022] GET /compute/v2.1/servers/ce0e0a34-0d2e-4525-a6f0-71263e2a1fb6 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:10:34.934811 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-65766d10-bdfe-4662-bf01-67c0b21465d4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:34.948925 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-65766d10-bdfe-4662-bf01-67c0b21465d4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:34.951138 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-65766d10-bdfe-4662-bf01-67c0b21465d4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:34.952750 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-65766d10-bdfe-4662-bf01-67c0b21465d4 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1739 microversion: 2.20 time: 0.397138 Feb 20 20:10:34.954377 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 437/862] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:34 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1739 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:35.977217 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-af3d6da9-dbe2-4e70-9a41-2fc6f091f79d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:35.978636 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-af3d6da9-dbe2-4e70-9a41-2fc6f091f79d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:35.990488 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-af3d6da9-dbe2-4e70-9a41-2fc6f091f79d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:35.992537 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-af3d6da9-dbe2-4e70-9a41-2fc6f091f79d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:35.994091 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-af3d6da9-dbe2-4e70-9a41-2fc6f091f79d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:35.995037 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-af3d6da9-dbe2-4e70-9a41-2fc6f091f79d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:36.193826 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-af3d6da9-dbe2-4e70-9a41-2fc6f091f79d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:36.205684 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-af3d6da9-dbe2-4e70-9a41-2fc6f091f79d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:36.207980 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-af3d6da9-dbe2-4e70-9a41-2fc6f091f79d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:36.209372 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-af3d6da9-dbe2-4e70-9a41-2fc6f091f79d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1739 microversion: 2.20 time: 0.237689 Feb 20 20:10:36.209926 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 426/863] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:35 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:37.229965 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-21dea69b-060d-45cf-bfeb-d4ba4978b622 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:37.230518 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-21dea69b-060d-45cf-bfeb-d4ba4978b622 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:37.237679 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-21dea69b-060d-45cf-bfeb-d4ba4978b622 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:37.238637 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-21dea69b-060d-45cf-bfeb-d4ba4978b622 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:37.239877 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-21dea69b-060d-45cf-bfeb-d4ba4978b622 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:37.240644 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-21dea69b-060d-45cf-bfeb-d4ba4978b622 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:37.592760 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-21dea69b-060d-45cf-bfeb-d4ba4978b622 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:37.602907 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-21dea69b-060d-45cf-bfeb-d4ba4978b622 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:37.604863 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-21dea69b-060d-45cf-bfeb-d4ba4978b622 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:37.606394 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-21dea69b-060d-45cf-bfeb-d4ba4978b622 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1739 microversion: 2.20 time: 0.381927 Feb 20 20:10:37.607332 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 438/864] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:37 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1739 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:38.642901 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5bcd6b33-8736-4942-9252-e32476ebe7c2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:38.642901 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5bcd6b33-8736-4942-9252-e32476ebe7c2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:38.649062 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5bcd6b33-8736-4942-9252-e32476ebe7c2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:38.649062 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5bcd6b33-8736-4942-9252-e32476ebe7c2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:38.653035 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5bcd6b33-8736-4942-9252-e32476ebe7c2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:38.653818 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5bcd6b33-8736-4942-9252-e32476ebe7c2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:39.317742 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5bcd6b33-8736-4942-9252-e32476ebe7c2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:39.326598 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5bcd6b33-8736-4942-9252-e32476ebe7c2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:39.328503 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5bcd6b33-8736-4942-9252-e32476ebe7c2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:39.334464 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5bcd6b33-8736-4942-9252-e32476ebe7c2 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1721 microversion: 2.20 time: 0.699050 Feb 20 20:10:39.338899 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 427/865] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:38 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1721 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:40.353702 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6b2e64e1-71f0-456d-b079-48f9e319ee02 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:40.354616 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6b2e64e1-71f0-456d-b079-48f9e319ee02 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:40.363417 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6b2e64e1-71f0-456d-b079-48f9e319ee02 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:40.364665 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6b2e64e1-71f0-456d-b079-48f9e319ee02 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:40.366360 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6b2e64e1-71f0-456d-b079-48f9e319ee02 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:40.367019 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6b2e64e1-71f0-456d-b079-48f9e319ee02 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:40.558754 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6b2e64e1-71f0-456d-b079-48f9e319ee02 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:40.575857 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6b2e64e1-71f0-456d-b079-48f9e319ee02 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:40.577323 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6b2e64e1-71f0-456d-b079-48f9e319ee02 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:40.578517 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6b2e64e1-71f0-456d-b079-48f9e319ee02 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1721 microversion: 2.20 time: 0.231875 Feb 20 20:10:40.579074 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 439/866] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:40 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1721 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:41.056989 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-7f6ddb63-6ec7-4c7a-92b2-b06465bb8bba req-d84658cb-8198-4588-bc41-47c634eecff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f60f31-e3e4-4705-910a-d01bdba1d965", "name": "network-vif-unplugged", "status": "completed", "tag": "1a899be1-fae4-4e55-ab37-e5b2c436daf0"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:10:41.058862 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:10:41.058862 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:10:41.069586 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-7f6ddb63-6ec7-4c7a-92b2-b06465bb8bba req-d84658cb-8198-4588-bc41-47c634eecff3 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:41.070596 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-7f6ddb63-6ec7-4c7a-92b2-b06465bb8bba req-d84658cb-8198-4588-bc41-47c634eecff3 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:41.089346 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-7f6ddb63-6ec7-4c7a-92b2-b06465bb8bba req-d84658cb-8198-4588-bc41-47c634eecff3 service nova] Creating event network-vif-unplugged:1a899be1-fae4-4e55-ab37-e5b2c436daf0 for instance d2f60f31-e3e4-4705-910a-d01bdba1d965 on hv-cinder-83008 Feb 20 20:10:41.096620 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-7f6ddb63-6ec7-4c7a-92b2-b06465bb8bba req-d84658cb-8198-4588-bc41-47c634eecff3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043323 Feb 20 20:10:41.097654 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 428/867] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:10:41.597022 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-317d6f6d-04d8-455f-9e71-c97e959e24f9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:41.598051 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-317d6f6d-04d8-455f-9e71-c97e959e24f9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:41.605874 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-317d6f6d-04d8-455f-9e71-c97e959e24f9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:41.606665 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-317d6f6d-04d8-455f-9e71-c97e959e24f9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:41.608030 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-317d6f6d-04d8-455f-9e71-c97e959e24f9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:41.608795 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-317d6f6d-04d8-455f-9e71-c97e959e24f9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:41.787612 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-317d6f6d-04d8-455f-9e71-c97e959e24f9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:41.796919 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-317d6f6d-04d8-455f-9e71-c97e959e24f9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:41.798760 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-317d6f6d-04d8-455f-9e71-c97e959e24f9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:41.799665 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-317d6f6d-04d8-455f-9e71-c97e959e24f9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1724 microversion: 2.20 time: 0.206706 Feb 20 20:10:41.800229 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 440/868] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:41 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:41.827386 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1b9098b0-cdf4-44a3-a9f3-a1f3aa52e065 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9f76c9f-96ac-49fe-af16-1b93ee30fdc9"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:10:41.828518 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1b9098b0-cdf4-44a3-a9f3-a1f3aa52e065 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:41.835113 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1b9098b0-cdf4-44a3-a9f3-a1f3aa52e065 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:41.835564 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1b9098b0-cdf4-44a3-a9f3-a1f3aa52e065 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:41.836359 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1b9098b0-cdf4-44a3-a9f3-a1f3aa52e065 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:41.836798 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1b9098b0-cdf4-44a3-a9f3-a1f3aa52e065 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:42.607196 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4ca178d0-e314-4fdf-8611-5f754ab7ab18 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:42.608120 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4ca178d0-e314-4fdf-8611-5f754ab7ab18 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:42.618919 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ca178d0-e314-4fdf-8611-5f754ab7ab18 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:42.619702 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ca178d0-e314-4fdf-8611-5f754ab7ab18 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:42.621107 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ca178d0-e314-4fdf-8611-5f754ab7ab18 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:42.622154 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4ca178d0-e314-4fdf-8611-5f754ab7ab18 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:42.687584 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4ca178d0-e314-4fdf-8611-5f754ab7ab18 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 20 20:10:42.971081 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1b9098b0-cdf4-44a3-a9f3-a1f3aa52e065 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "POST /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.147940 Feb 20 20:10:42.971874 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 429/869] 10.222.0.60 () {62 vars in 1363 bytes} [Sun Feb 20 20:10:41 2022] POST /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965/os-volume_attachments => generated 188 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 20 20:10:43.059467 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4ca178d0-e314-4fdf-8611-5f754ab7ab18 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "DELETE /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 204 len: 0 microversion: 2.1 time: 0.454818 Feb 20 20:10:43.061114 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 441/870] 10.222.0.60 () {58 vars in 1238 bytes} [Sun Feb 20 20:10:42 2022] DELETE /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 20 20:10:43.083264 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1bbfa1bd-8d72-4da4-ba30-7ad9a744cfd1 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:43.084145 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1bbfa1bd-8d72-4da4-ba30-7ad9a744cfd1 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:43.097211 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1bbfa1bd-8d72-4da4-ba30-7ad9a744cfd1 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:43.098578 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1bbfa1bd-8d72-4da4-ba30-7ad9a744cfd1 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:43.102641 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1bbfa1bd-8d72-4da4-ba30-7ad9a744cfd1 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:43.107341 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1bbfa1bd-8d72-4da4-ba30-7ad9a744cfd1 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:43.149818 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c58de710-4bf7-48fa-8eb6-9dafdb57b7a0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:43.150405 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c58de710-4bf7-48fa-8eb6-9dafdb57b7a0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:43.158031 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c58de710-4bf7-48fa-8eb6-9dafdb57b7a0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:43.158485 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c58de710-4bf7-48fa-8eb6-9dafdb57b7a0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:43.159819 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c58de710-4bf7-48fa-8eb6-9dafdb57b7a0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:43.161220 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c58de710-4bf7-48fa-8eb6-9dafdb57b7a0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:43.394203 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1bbfa1bd-8d72-4da4-ba30-7ad9a744cfd1 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:43.404709 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1bbfa1bd-8d72-4da4-ba30-7ad9a744cfd1 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 200 len: 1577 microversion: 2.1 time: 0.328532 Feb 20 20:10:43.405336 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 430/871] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:43 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 1577 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:43.924669 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c58de710-4bf7-48fa-8eb6-9dafdb57b7a0 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965/os-volume_attachments/c9f76c9f-96ac-49fe-af16-1b93ee30fdc9" status: 202 len: 0 microversion: 2.20 time: 0.779648 Feb 20 20:10:43.926642 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 442/872] 10.222.0.60 () {60 vars in 1456 bytes} [Sun Feb 20 20:10:43 2022] DELETE /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965/os-volume_attachments/c9f76c9f-96ac-49fe-af16-1b93ee30fdc9 => generated 0 bytes in 783 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 20 20:10:44.011977 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-25a54a03-8bd7-43bb-a214-baa5a11ea703 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:10:44.014462 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-25a54a03-8bd7-43bb-a214-baa5a11ea703 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:44.021265 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-25a54a03-8bd7-43bb-a214-baa5a11ea703 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:44.021707 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-25a54a03-8bd7-43bb-a214-baa5a11ea703 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:44.022483 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-25a54a03-8bd7-43bb-a214-baa5a11ea703 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:44.023128 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-25a54a03-8bd7-43bb-a214-baa5a11ea703 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:44.260240 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-25a54a03-8bd7-43bb-a214-baa5a11ea703 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "POST /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965/action" status: 202 len: 0 microversion: 2.20 time: 0.251542 Feb 20 20:10:44.261867 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 431/873] 10.222.0.60 () {62 vars in 1318 bytes} [Sun Feb 20 20:10:44 2022] POST /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 20 20:10:44.271825 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-96a9211c-6b41-43c8-996e-7f295324f869 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:44.271825 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-96a9211c-6b41-43c8-996e-7f295324f869 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:44.280149 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-96a9211c-6b41-43c8-996e-7f295324f869 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:44.280825 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-96a9211c-6b41-43c8-996e-7f295324f869 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:44.281744 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-96a9211c-6b41-43c8-996e-7f295324f869 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:44.282334 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-96a9211c-6b41-43c8-996e-7f295324f869 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:44.430218 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-334b67f1-799a-4d91-80c2-05bd383ab290 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:44.431553 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-334b67f1-799a-4d91-80c2-05bd383ab290 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:44.451755 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-334b67f1-799a-4d91-80c2-05bd383ab290 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:44.452847 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-334b67f1-799a-4d91-80c2-05bd383ab290 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:44.454017 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-334b67f1-799a-4d91-80c2-05bd383ab290 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:44.455861 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-334b67f1-799a-4d91-80c2-05bd383ab290 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:44.495931 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-96a9211c-6b41-43c8-996e-7f295324f869 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:44.505205 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-96a9211c-6b41-43c8-996e-7f295324f869 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:44.507562 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-96a9211c-6b41-43c8-996e-7f295324f869 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:44.509388 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-96a9211c-6b41-43c8-996e-7f295324f869 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1672 microversion: 2.20 time: 0.242278 Feb 20 20:10:44.521419 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 443/874] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:44 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1672 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:10:44.656447 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-334b67f1-799a-4d91-80c2-05bd383ab290 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:44.666489 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-334b67f1-799a-4d91-80c2-05bd383ab290 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 200 len: 1577 microversion: 2.1 time: 0.242538 Feb 20 20:10:44.678271 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 432/875] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:44 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 1577 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:10:45.530447 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-74aed6f1-b66f-48b3-8551-225e455cbd9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:45.530447 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-74aed6f1-b66f-48b3-8551-225e455cbd9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:45.544802 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-74aed6f1-b66f-48b3-8551-225e455cbd9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:45.544802 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-74aed6f1-b66f-48b3-8551-225e455cbd9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:45.544802 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-74aed6f1-b66f-48b3-8551-225e455cbd9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:45.544802 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-74aed6f1-b66f-48b3-8551-225e455cbd9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:45.685198 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6b66c7be-9620-45b5-9217-4d3ba0b360e3 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:45.685811 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6b66c7be-9620-45b5-9217-4d3ba0b360e3 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:45.692787 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6b66c7be-9620-45b5-9217-4d3ba0b360e3 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:45.693256 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6b66c7be-9620-45b5-9217-4d3ba0b360e3 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:45.694026 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6b66c7be-9620-45b5-9217-4d3ba0b360e3 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:45.694462 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6b66c7be-9620-45b5-9217-4d3ba0b360e3 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:45.880653 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-74aed6f1-b66f-48b3-8551-225e455cbd9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:45.890700 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-74aed6f1-b66f-48b3-8551-225e455cbd9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:45.892084 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-74aed6f1-b66f-48b3-8551-225e455cbd9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:45.893294 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-74aed6f1-b66f-48b3-8551-225e455cbd9c tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1672 microversion: 2.20 time: 0.368297 Feb 20 20:10:45.895949 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 444/876] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:45 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1672 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:45.989933 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6b66c7be-9620-45b5-9217-4d3ba0b360e3 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:45.997476 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6b66c7be-9620-45b5-9217-4d3ba0b360e3 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 200 len: 1577 microversion: 2.1 time: 0.315933 Feb 20 20:10:46.007856 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 433/877] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:45 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 1577 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:10:46.576994 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-55a23110-2aba-4bd4-9e1f-5ab91b4eeb2e req-4a7227bc-6a9a-4155-8307-89b8375fb3be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14017978-5ca1-41e3-9cee-2b9fe9d737d3", "name": "network-vif-deleted", "tag": "3a701361-cf5b-4df9-9369-e732da8ed34c"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:10:46.582869 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:10:46.582869 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:10:46.595018 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-55a23110-2aba-4bd4-9e1f-5ab91b4eeb2e req-4a7227bc-6a9a-4155-8307-89b8375fb3be service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:46.597390 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-55a23110-2aba-4bd4-9e1f-5ab91b4eeb2e req-4a7227bc-6a9a-4155-8307-89b8375fb3be service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:46.621548 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-55a23110-2aba-4bd4-9e1f-5ab91b4eeb2e req-4a7227bc-6a9a-4155-8307-89b8375fb3be service nova] Creating event network-vif-deleted:3a701361-cf5b-4df9-9369-e732da8ed34c for instance 14017978-5ca1-41e3-9cee-2b9fe9d737d3 on hv-cinder-83008 Feb 20 20:10:46.630440 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-55a23110-2aba-4bd4-9e1f-5ab91b4eeb2e req-4a7227bc-6a9a-4155-8307-89b8375fb3be service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061074 Feb 20 20:10:46.631263 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 445/878] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:10:46.923256 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-35441ee6-07bb-43b8-89d7-25f5a864dabb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:46.924038 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-35441ee6-07bb-43b8-89d7-25f5a864dabb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:46.932325 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-35441ee6-07bb-43b8-89d7-25f5a864dabb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:46.932773 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-35441ee6-07bb-43b8-89d7-25f5a864dabb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:46.933576 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-35441ee6-07bb-43b8-89d7-25f5a864dabb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:46.934002 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-35441ee6-07bb-43b8-89d7-25f5a864dabb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:47.017611 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2a0d6d5a-8a61-40c7-9b50-3383c1a0a45c tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:47.021038 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2a0d6d5a-8a61-40c7-9b50-3383c1a0a45c tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:47.030356 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2a0d6d5a-8a61-40c7-9b50-3383c1a0a45c tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:47.037332 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2a0d6d5a-8a61-40c7-9b50-3383c1a0a45c tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:47.038937 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2a0d6d5a-8a61-40c7-9b50-3383c1a0a45c tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:47.039778 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2a0d6d5a-8a61-40c7-9b50-3383c1a0a45c tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:47.148321 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2a0d6d5a-8a61-40c7-9b50-3383c1a0a45c tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:47.157912 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2a0d6d5a-8a61-40c7-9b50-3383c1a0a45c tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 200 len: 1225 microversion: 2.1 time: 0.145446 Feb 20 20:10:47.159151 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 446/879] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:47 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 1225 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:47.185039 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-35441ee6-07bb-43b8-89d7-25f5a864dabb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:47.196222 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-35441ee6-07bb-43b8-89d7-25f5a864dabb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:47.197896 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-35441ee6-07bb-43b8-89d7-25f5a864dabb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:47.199216 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-35441ee6-07bb-43b8-89d7-25f5a864dabb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1674 microversion: 2.20 time: 0.282854 Feb 20 20:10:47.200437 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 434/880] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:46 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1674 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:48.177379 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-deb33ed8-b70e-4689-a257-34c03ee99504 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:48.177992 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-deb33ed8-b70e-4689-a257-34c03ee99504 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:48.184770 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-deb33ed8-b70e-4689-a257-34c03ee99504 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:48.185421 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-deb33ed8-b70e-4689-a257-34c03ee99504 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:48.186226 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-deb33ed8-b70e-4689-a257-34c03ee99504 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:48.186764 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-deb33ed8-b70e-4689-a257-34c03ee99504 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:48.224088 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1955513f-4984-4263-8759-6f6643148b4d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:48.225428 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1955513f-4984-4263-8759-6f6643148b4d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:48.225582 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-deb33ed8-b70e-4689-a257-34c03ee99504 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:48.226032 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-deb33ed8-b70e-4689-a257-34c03ee99504 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:48.226497 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-deb33ed8-b70e-4689-a257-34c03ee99504 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lazy-loading 'fault' on Instance uuid 14017978-5ca1-41e3-9cee-2b9fe9d737d3 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:10:48.232681 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1955513f-4984-4263-8759-6f6643148b4d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:48.233246 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1955513f-4984-4263-8759-6f6643148b4d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:48.234272 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1955513f-4984-4263-8759-6f6643148b4d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:48.234442 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1955513f-4984-4263-8759-6f6643148b4d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:48.279923 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-deb33ed8-b70e-4689-a257-34c03ee99504 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:48.288261 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-deb33ed8-b70e-4689-a257-34c03ee99504 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 200 len: 1184 microversion: 2.1 time: 0.114852 Feb 20 20:10:48.288894 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 447/881] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:48 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 1184 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:48.397180 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1955513f-4984-4263-8759-6f6643148b4d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:48.405649 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1955513f-4984-4263-8759-6f6643148b4d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:48.407144 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1955513f-4984-4263-8759-6f6643148b4d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:48.408301 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1955513f-4984-4263-8759-6f6643148b4d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1730 microversion: 2.20 time: 0.189314 Feb 20 20:10:48.408937 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 435/882] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:48 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:10:49.323531 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7f482cf1-7273-4943-8e2c-450c03fed43f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:49.327319 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7f482cf1-7273-4943-8e2c-450c03fed43f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:49.341949 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7f482cf1-7273-4943-8e2c-450c03fed43f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:49.343095 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7f482cf1-7273-4943-8e2c-450c03fed43f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:49.344502 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7f482cf1-7273-4943-8e2c-450c03fed43f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:49.345180 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7f482cf1-7273-4943-8e2c-450c03fed43f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:49.364632 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-7f482cf1-7273-4943-8e2c-450c03fed43f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] HTTP exception thrown: Instance 14017978-5ca1-41e3-9cee-2b9fe9d737d3 could not be found. Feb 20 20:10:49.365383 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7f482cf1-7273-4943-8e2c-450c03fed43f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Returning 404 to user: Instance 14017978-5ca1-41e3-9cee-2b9fe9d737d3 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:10:49.366371 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7f482cf1-7273-4943-8e2c-450c03fed43f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 404 len: 111 microversion: 2.1 time: 0.056325 Feb 20 20:10:49.377302 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 448/883] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:49 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:10:49.427674 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-eee846bc-9241-432e-99ed-3f8ea55b27bb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:49.429118 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-eee846bc-9241-432e-99ed-3f8ea55b27bb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:49.435598 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-eee846bc-9241-432e-99ed-3f8ea55b27bb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:49.436768 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-eee846bc-9241-432e-99ed-3f8ea55b27bb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:49.436922 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-eee846bc-9241-432e-99ed-3f8ea55b27bb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:49.437856 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-eee846bc-9241-432e-99ed-3f8ea55b27bb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:49.534667 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-921c1d86-cecb-4068-83c7-db4464f3e8f4 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1691133064", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-640523116", "security_groups": [{"name": "tempest-secgroup-smoke-1140847490"}], "block_device_mapping_v2": [{"uuid": "c23d5de0-304f-4635-b8e5-c516eec0c693", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3ddb480e-c808-4081-b0cb-679d7704b478"}]}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:10:49.669985 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-eee846bc-9241-432e-99ed-3f8ea55b27bb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:49.690441 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-eee846bc-9241-432e-99ed-3f8ea55b27bb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:49.693177 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-eee846bc-9241-432e-99ed-3f8ea55b27bb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:49.695764 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-eee846bc-9241-432e-99ed-3f8ea55b27bb tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1730 microversion: 2.20 time: 0.272925 Feb 20 20:10:49.696701 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 436/884] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:49 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1730 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:49.746764 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.network.neutron [None req-921c1d86-cecb-4068-83c7-db4464f3e8f4 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] validate_networks() for [('3ddb480e-c808-4081-b0cb-679d7704b478', None, None, None, None, None)] {{(pid=117088) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 20 20:10:50.681165 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-921c1d86-cecb-4068-83c7-db4464f3e8f4 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Flavor limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 20 20:10:50.681165 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-921c1d86-cecb-4068-83c7-db4464f3e8f4 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Image limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 20 20:10:50.682293 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-921c1d86-cecb-4068-83c7-db4464f3e8f4 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Flavor pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 20 20:10:50.682293 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-921c1d86-cecb-4068-83c7-db4464f3e8f4 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Image pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 20 20:10:50.682619 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-921c1d86-cecb-4068-83c7-db4464f3e8f4 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 20 20:10:50.702472 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-921c1d86-cecb-4068-83c7-db4464f3e8f4 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:50.702472 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-921c1d86-cecb-4068-83c7-db4464f3e8f4 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:50.702903 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-921c1d86-cecb-4068-83c7-db4464f3e8f4 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:50.707886 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-921c1d86-cecb-4068-83c7-db4464f3e8f4 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:50.716242 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-31258b65-cb6e-47ce-acb3-3ae9712311ad tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:50.717651 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-31258b65-cb6e-47ce-acb3-3ae9712311ad tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:50.734975 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-31258b65-cb6e-47ce-acb3-3ae9712311ad tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:50.735445 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-31258b65-cb6e-47ce-acb3-3ae9712311ad tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:50.736235 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-31258b65-cb6e-47ce-acb3-3ae9712311ad tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:50.736677 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-31258b65-cb6e-47ce-acb3-3ae9712311ad tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:50.746697 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-921c1d86-cecb-4068-83c7-db4464f3e8f4 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Getting quotas for project 7d15dcb9692c401e9d0e06361839bb8b. Resources: {'instances', 'cores', 'ram'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:10:50.756553 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-921c1d86-cecb-4068-83c7-db4464f3e8f4 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Getting quotas for user 62b3136320e64532991e5dd5a199e4d8 and project 7d15dcb9692c401e9d0e06361839bb8b. Resources: {'instances', 'cores', 'ram'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:10:50.853675 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-921c1d86-cecb-4068-83c7-db4464f3e8f4 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Going to run 1 instances... {{(pid=117088) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 20 20:10:50.856106 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-921c1d86-cecb-4068-83c7-db4464f3e8f4 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c23d5de0-304f-4635-b8e5-c516eec0c693',volume_size=None,volume_type=None)] {{(pid=117088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 20 20:10:50.946985 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-31258b65-cb6e-47ce-acb3-3ae9712311ad tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:50.967023 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-31258b65-cb6e-47ce-acb3-3ae9712311ad tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:50.969724 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-31258b65-cb6e-47ce-acb3-3ae9712311ad tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:50.971604 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-31258b65-cb6e-47ce-acb3-3ae9712311ad tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1730 microversion: 2.20 time: 0.259915 Feb 20 20:10:50.972222 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 437/885] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:50 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1730 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:51.316935 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-921c1d86-cecb-4068-83c7-db4464f3e8f4 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.794019 Feb 20 20:10:51.318223 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 449/886] 10.222.0.60 () {60 vars in 1146 bytes} [Sun Feb 20 20:10:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 20 20:10:51.332979 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-39dbf802-3ef6-4a9f-af4a-c58722cf1104 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:51.334343 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-39dbf802-3ef6-4a9f-af4a-c58722cf1104 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:51.491571 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-39dbf802-3ef6-4a9f-af4a-c58722cf1104 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:51.539445 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-39dbf802-3ef6-4a9f-af4a-c58722cf1104 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1094 microversion: 2.1 time: 0.214475 Feb 20 20:10:51.540319 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 438/887] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:51 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1094 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:51.996309 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-53de67b8-565d-49d0-9159-d68f004cd808 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:52.001428 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-53de67b8-565d-49d0-9159-d68f004cd808 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:52.011233 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-53de67b8-565d-49d0-9159-d68f004cd808 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:52.011772 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-53de67b8-565d-49d0-9159-d68f004cd808 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:52.012770 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-53de67b8-565d-49d0-9159-d68f004cd808 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:52.013427 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-53de67b8-565d-49d0-9159-d68f004cd808 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:52.322211 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-53de67b8-565d-49d0-9159-d68f004cd808 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:52.336760 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-53de67b8-565d-49d0-9159-d68f004cd808 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:52.351089 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-53de67b8-565d-49d0-9159-d68f004cd808 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:52.364736 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-53de67b8-565d-49d0-9159-d68f004cd808 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1730 microversion: 2.20 time: 0.365617 Feb 20 20:10:52.364736 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 450/888] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:51 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1730 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:52.561753 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7702849f-c5eb-4d1c-b471-e20665ad41be tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:52.562444 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7702849f-c5eb-4d1c-b471-e20665ad41be tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:52.714648 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7702849f-c5eb-4d1c-b471-e20665ad41be tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:52.725539 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7702849f-c5eb-4d1c-b471-e20665ad41be tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1094 microversion: 2.1 time: 0.167868 Feb 20 20:10:52.736080 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 439/889] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:52 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1094 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:53.383512 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-14c22da1-e7ae-47d2-b87f-b85ac60d1fd6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:53.384830 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-14c22da1-e7ae-47d2-b87f-b85ac60d1fd6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:53.399033 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-14c22da1-e7ae-47d2-b87f-b85ac60d1fd6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:53.405897 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-14c22da1-e7ae-47d2-b87f-b85ac60d1fd6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:53.406823 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-14c22da1-e7ae-47d2-b87f-b85ac60d1fd6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:53.407644 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-14c22da1-e7ae-47d2-b87f-b85ac60d1fd6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:53.636012 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-14c22da1-e7ae-47d2-b87f-b85ac60d1fd6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:53.646747 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-14c22da1-e7ae-47d2-b87f-b85ac60d1fd6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:53.648893 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-14c22da1-e7ae-47d2-b87f-b85ac60d1fd6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:53.651275 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-14c22da1-e7ae-47d2-b87f-b85ac60d1fd6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1730 microversion: 2.20 time: 0.272274 Feb 20 20:10:53.652473 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 451/890] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:53 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1730 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:53.745641 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-dc62e48e-67e8-4eb0-9d56-8bf22dcf7ab8 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:53.754542 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-dc62e48e-67e8-4eb0-9d56-8bf22dcf7ab8 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:53.756045 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dc62e48e-67e8-4eb0-9d56-8bf22dcf7ab8 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:53.756832 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dc62e48e-67e8-4eb0-9d56-8bf22dcf7ab8 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:53.757879 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dc62e48e-67e8-4eb0-9d56-8bf22dcf7ab8 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:53.758663 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dc62e48e-67e8-4eb0-9d56-8bf22dcf7ab8 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:53.923708 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-dc62e48e-67e8-4eb0-9d56-8bf22dcf7ab8 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:53.933194 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-dc62e48e-67e8-4eb0-9d56-8bf22dcf7ab8 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1144 microversion: 2.1 time: 0.193179 Feb 20 20:10:53.945222 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 440/891] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:53 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1144 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:54.688043 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-690f7ec5-c469-4803-9308-c327dc1ccef1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:54.688766 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-690f7ec5-c469-4803-9308-c327dc1ccef1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:54.702693 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-690f7ec5-c469-4803-9308-c327dc1ccef1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:54.897893 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-690f7ec5-c469-4803-9308-c327dc1ccef1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:54.897893 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-690f7ec5-c469-4803-9308-c327dc1ccef1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:54.897893 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-690f7ec5-c469-4803-9308-c327dc1ccef1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:54.898307 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-690f7ec5-c469-4803-9308-c327dc1ccef1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:54.898307 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-690f7ec5-c469-4803-9308-c327dc1ccef1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:54.898622 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-690f7ec5-c469-4803-9308-c327dc1ccef1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:54.898622 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-690f7ec5-c469-4803-9308-c327dc1ccef1 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1730 microversion: 2.20 time: 0.196952 Feb 20 20:10:54.898622 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 452/892] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:54 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:54.955946 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-0f50256e-5bfe-41ea-a9c7-b5ad1c4d1adf tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:54.958820 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-0f50256e-5bfe-41ea-a9c7-b5ad1c4d1adf tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:54.973561 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0f50256e-5bfe-41ea-a9c7-b5ad1c4d1adf tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:54.974641 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0f50256e-5bfe-41ea-a9c7-b5ad1c4d1adf tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:54.976331 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0f50256e-5bfe-41ea-a9c7-b5ad1c4d1adf tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:54.977538 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0f50256e-5bfe-41ea-a9c7-b5ad1c4d1adf tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:55.098610 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0f50256e-5bfe-41ea-a9c7-b5ad1c4d1adf tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:55.115445 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-0f50256e-5bfe-41ea-a9c7-b5ad1c4d1adf tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1144 microversion: 2.1 time: 0.165748 Feb 20 20:10:55.123274 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 441/893] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:54 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1144 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:55.915835 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a291666e-1a35-4f3e-99d3-3bec914d2a50 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:55.917529 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a291666e-1a35-4f3e-99d3-3bec914d2a50 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:55.932824 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a291666e-1a35-4f3e-99d3-3bec914d2a50 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:55.933292 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a291666e-1a35-4f3e-99d3-3bec914d2a50 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:55.939986 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a291666e-1a35-4f3e-99d3-3bec914d2a50 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:55.940914 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a291666e-1a35-4f3e-99d3-3bec914d2a50 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:56.156950 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-23bef8f5-aee3-4eb2-a314-b9b73403738e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:56.157843 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-23bef8f5-aee3-4eb2-a314-b9b73403738e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:56.187773 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-23bef8f5-aee3-4eb2-a314-b9b73403738e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:56.188655 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-23bef8f5-aee3-4eb2-a314-b9b73403738e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:56.190811 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-23bef8f5-aee3-4eb2-a314-b9b73403738e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:56.192536 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-23bef8f5-aee3-4eb2-a314-b9b73403738e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:56.270654 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a291666e-1a35-4f3e-99d3-3bec914d2a50 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:56.288011 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a291666e-1a35-4f3e-99d3-3bec914d2a50 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:56.293576 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a291666e-1a35-4f3e-99d3-3bec914d2a50 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:56.294966 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a291666e-1a35-4f3e-99d3-3bec914d2a50 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1730 microversion: 2.20 time: 0.385738 Feb 20 20:10:56.297155 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 453/894] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:55 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1730 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:56.333276 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-23bef8f5-aee3-4eb2-a314-b9b73403738e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:56.348268 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-23bef8f5-aee3-4eb2-a314-b9b73403738e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1144 microversion: 2.1 time: 0.206966 Feb 20 20:10:56.360999 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 442/895] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:56 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1144 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:10:57.318388 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d184a6fc-fe7b-40d5-b554-3e21bc6fe3c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:57.319233 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d184a6fc-fe7b-40d5-b554-3e21bc6fe3c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:57.327338 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d184a6fc-fe7b-40d5-b554-3e21bc6fe3c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:57.327920 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d184a6fc-fe7b-40d5-b554-3e21bc6fe3c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:57.329309 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d184a6fc-fe7b-40d5-b554-3e21bc6fe3c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:57.329867 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d184a6fc-fe7b-40d5-b554-3e21bc6fe3c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:57.367405 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-78d19d2d-b6cd-426d-9dd0-8d9ccdb8dfab tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:57.368015 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-78d19d2d-b6cd-426d-9dd0-8d9ccdb8dfab tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:57.378250 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-78d19d2d-b6cd-426d-9dd0-8d9ccdb8dfab tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:57.380473 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-78d19d2d-b6cd-426d-9dd0-8d9ccdb8dfab tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:57.384763 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-78d19d2d-b6cd-426d-9dd0-8d9ccdb8dfab tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:57.386582 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-78d19d2d-b6cd-426d-9dd0-8d9ccdb8dfab tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:57.468285 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-78d19d2d-b6cd-426d-9dd0-8d9ccdb8dfab tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:57.476701 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-78d19d2d-b6cd-426d-9dd0-8d9ccdb8dfab tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1144 microversion: 2.1 time: 0.113363 Feb 20 20:10:57.477348 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 443/896] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:57 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1144 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:10:57.521524 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d184a6fc-fe7b-40d5-b554-3e21bc6fe3c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:57.531106 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d184a6fc-fe7b-40d5-b554-3e21bc6fe3c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:57.532631 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d184a6fc-fe7b-40d5-b554-3e21bc6fe3c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:57.533930 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d184a6fc-fe7b-40d5-b554-3e21bc6fe3c9 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1730 microversion: 2.20 time: 0.221667 Feb 20 20:10:57.534614 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 454/897] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:57 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1730 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:10:58.493621 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6745c2f1-aecd-4dc3-8cfd-872fd323ba4e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:58.494535 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6745c2f1-aecd-4dc3-8cfd-872fd323ba4e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:58.500767 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6745c2f1-aecd-4dc3-8cfd-872fd323ba4e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:58.501264 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6745c2f1-aecd-4dc3-8cfd-872fd323ba4e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:58.502047 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6745c2f1-aecd-4dc3-8cfd-872fd323ba4e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:58.502483 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6745c2f1-aecd-4dc3-8cfd-872fd323ba4e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:58.552456 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f79df48c-e5b2-4856-9867-1b99bb166fbd tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:58.553375 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f79df48c-e5b2-4856-9867-1b99bb166fbd tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:58.560025 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f79df48c-e5b2-4856-9867-1b99bb166fbd tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:58.560552 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f79df48c-e5b2-4856-9867-1b99bb166fbd tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:58.561456 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f79df48c-e5b2-4856-9867-1b99bb166fbd tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:58.561949 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f79df48c-e5b2-4856-9867-1b99bb166fbd tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:58.575582 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6745c2f1-aecd-4dc3-8cfd-872fd323ba4e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:58.585907 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6745c2f1-aecd-4dc3-8cfd-872fd323ba4e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1144 microversion: 2.1 time: 0.095636 Feb 20 20:10:58.586662 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 444/898] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:58 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1144 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:58.714345 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f79df48c-e5b2-4856-9867-1b99bb166fbd tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:58.723007 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f79df48c-e5b2-4856-9867-1b99bb166fbd tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:58.724650 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f79df48c-e5b2-4856-9867-1b99bb166fbd tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:58.725925 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f79df48c-e5b2-4856-9867-1b99bb166fbd tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1730 microversion: 2.20 time: 0.177855 Feb 20 20:10:58.726540 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 455/899] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:58 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:10:59.604483 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-29a61e14-e8eb-4279-921c-1a85b5d6d90d tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:59.605134 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-29a61e14-e8eb-4279-921c-1a85b5d6d90d tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:59.612847 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-29a61e14-e8eb-4279-921c-1a85b5d6d90d tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:59.612847 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-29a61e14-e8eb-4279-921c-1a85b5d6d90d tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:59.614889 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-29a61e14-e8eb-4279-921c-1a85b5d6d90d tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:59.614889 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-29a61e14-e8eb-4279-921c-1a85b5d6d90d tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:59.712956 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-29a61e14-e8eb-4279-921c-1a85b5d6d90d tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:10:59.721605 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-29a61e14-e8eb-4279-921c-1a85b5d6d90d tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1136 microversion: 2.1 time: 0.120596 Feb 20 20:10:59.722202 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 445/900] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:10:59 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1136 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:10:59.745259 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-19398fa2-7ba7-4c7b-a90c-d70f978f8cb6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:10:59.745259 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-19398fa2-7ba7-4c7b-a90c-d70f978f8cb6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:10:59.751929 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-19398fa2-7ba7-4c7b-a90c-d70f978f8cb6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:59.752382 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-19398fa2-7ba7-4c7b-a90c-d70f978f8cb6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:10:59.753241 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-19398fa2-7ba7-4c7b-a90c-d70f978f8cb6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:10:59.753676 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-19398fa2-7ba7-4c7b-a90c-d70f978f8cb6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:00.029367 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-19398fa2-7ba7-4c7b-a90c-d70f978f8cb6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:00.040154 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-19398fa2-7ba7-4c7b-a90c-d70f978f8cb6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:00.041934 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-19398fa2-7ba7-4c7b-a90c-d70f978f8cb6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:00.043208 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-19398fa2-7ba7-4c7b-a90c-d70f978f8cb6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1730 microversion: 2.20 time: 0.302951 Feb 20 20:11:00.043811 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 456/901] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:10:59 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1730 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:11:00.745574 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-02d18455-ee0e-4efe-9d6f-9bda9fbe349a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:00.746508 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-02d18455-ee0e-4efe-9d6f-9bda9fbe349a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:00.754356 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-02d18455-ee0e-4efe-9d6f-9bda9fbe349a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:00.759084 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-02d18455-ee0e-4efe-9d6f-9bda9fbe349a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:00.759084 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-02d18455-ee0e-4efe-9d6f-9bda9fbe349a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:00.759084 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-02d18455-ee0e-4efe-9d6f-9bda9fbe349a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:00.844106 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-02d18455-ee0e-4efe-9d6f-9bda9fbe349a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:00.861076 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-02d18455-ee0e-4efe-9d6f-9bda9fbe349a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1200 microversion: 2.1 time: 0.119504 Feb 20 20:11:00.862441 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 446/902] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:00 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1200 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:01.065568 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-46e34f84-5665-46ef-8dc2-04d8486e4c0f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:01.066825 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-46e34f84-5665-46ef-8dc2-04d8486e4c0f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:01.079810 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-46e34f84-5665-46ef-8dc2-04d8486e4c0f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:01.080544 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-46e34f84-5665-46ef-8dc2-04d8486e4c0f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:01.083785 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-46e34f84-5665-46ef-8dc2-04d8486e4c0f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:01.085167 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-46e34f84-5665-46ef-8dc2-04d8486e4c0f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:01.368351 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-46e34f84-5665-46ef-8dc2-04d8486e4c0f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:01.378016 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-46e34f84-5665-46ef-8dc2-04d8486e4c0f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:01.379704 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-46e34f84-5665-46ef-8dc2-04d8486e4c0f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:01.381692 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-46e34f84-5665-46ef-8dc2-04d8486e4c0f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1730 microversion: 2.20 time: 0.322376 Feb 20 20:11:01.393511 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 457/903] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:11:01 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1730 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:11:01.882181 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9c5a1046-d945-44b3-b331-2984b99fc27f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:01.883359 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9c5a1046-d945-44b3-b331-2984b99fc27f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:01.890532 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9c5a1046-d945-44b3-b331-2984b99fc27f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:01.891462 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9c5a1046-d945-44b3-b331-2984b99fc27f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:01.892478 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9c5a1046-d945-44b3-b331-2984b99fc27f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:01.893152 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9c5a1046-d945-44b3-b331-2984b99fc27f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:02.400215 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3baadc48-d2f1-42b7-a6cb-b7dd5804e20b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:02.408127 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-3baadc48-d2f1-42b7-a6cb-b7dd5804e20b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:02.408127 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3baadc48-d2f1-42b7-a6cb-b7dd5804e20b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:02.408832 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3baadc48-d2f1-42b7-a6cb-b7dd5804e20b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:02.409845 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3baadc48-d2f1-42b7-a6cb-b7dd5804e20b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:02.410431 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3baadc48-d2f1-42b7-a6cb-b7dd5804e20b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:02.502815 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-9c5a1046-d945-44b3-b331-2984b99fc27f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:02.511339 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9c5a1046-d945-44b3-b331-2984b99fc27f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1278 microversion: 2.1 time: 0.634978 Feb 20 20:11:02.512032 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 447/904] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:01 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1278 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:11:02.686928 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3baadc48-d2f1-42b7-a6cb-b7dd5804e20b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:02.695953 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3baadc48-d2f1-42b7-a6cb-b7dd5804e20b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:02.697812 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3baadc48-d2f1-42b7-a6cb-b7dd5804e20b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:02.699322 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-3baadc48-d2f1-42b7-a6cb-b7dd5804e20b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1730 microversion: 2.20 time: 0.302676 Feb 20 20:11:02.705645 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 458/905] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:11:02 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1730 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:11:03.123770 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-55213332-a235-497c-bd18-0a6f97d87950 req-52db2e4b-80c2-44aa-8fe8-7078caabc0c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f60f31-e3e4-4705-910a-d01bdba1d965", "name": "network-vif-plugged", "status": "completed", "tag": "1a899be1-fae4-4e55-ab37-e5b2c436daf0"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:11:03.125419 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:11:03.125419 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:11:03.137018 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-55213332-a235-497c-bd18-0a6f97d87950 req-52db2e4b-80c2-44aa-8fe8-7078caabc0c0 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:03.137957 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-55213332-a235-497c-bd18-0a6f97d87950 req-52db2e4b-80c2-44aa-8fe8-7078caabc0c0 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:03.150148 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-55213332-a235-497c-bd18-0a6f97d87950 req-52db2e4b-80c2-44aa-8fe8-7078caabc0c0 service nova] Creating event network-vif-plugged:1a899be1-fae4-4e55-ab37-e5b2c436daf0 for instance d2f60f31-e3e4-4705-910a-d01bdba1d965 on hv-cinder-83008 Feb 20 20:11:03.155368 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-55213332-a235-497c-bd18-0a6f97d87950 req-52db2e4b-80c2-44aa-8fe8-7078caabc0c0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035333 Feb 20 20:11:03.161650 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 448/906] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:11:03.251449 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-6c985092-9df8-4739-ac73-f1c380ca4c88 req-71abe756-8e5f-4b22-8037-c0ba6edf8b50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c5dc901-3328-47a3-949d-97b1d3fd0f85", "tag": "9bb3be73-8f90-429e-b3c4-1a5cc212a013"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:11:03.254691 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:11:03.254691 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:11:03.278579 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-6c985092-9df8-4739-ac73-f1c380ca4c88 req-71abe756-8e5f-4b22-8037-c0ba6edf8b50 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:03.279341 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-6c985092-9df8-4739-ac73-f1c380ca4c88 req-71abe756-8e5f-4b22-8037-c0ba6edf8b50 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:03.301772 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-6c985092-9df8-4739-ac73-f1c380ca4c88 req-71abe756-8e5f-4b22-8037-c0ba6edf8b50 service nova] Creating event network-changed:9bb3be73-8f90-429e-b3c4-1a5cc212a013 for instance 0c5dc901-3328-47a3-949d-97b1d3fd0f85 on hv-cinder-83008 Feb 20 20:11:03.309707 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-6c985092-9df8-4739-ac73-f1c380ca4c88 req-71abe756-8e5f-4b22-8037-c0ba6edf8b50 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064008 Feb 20 20:11:03.311049 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 459/907] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:11:03.532717 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-dc44e24f-b240-42d3-99c7-20f0543ec800 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:03.533733 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-dc44e24f-b240-42d3-99c7-20f0543ec800 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:03.543632 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dc44e24f-b240-42d3-99c7-20f0543ec800 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:03.544098 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dc44e24f-b240-42d3-99c7-20f0543ec800 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:03.544898 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dc44e24f-b240-42d3-99c7-20f0543ec800 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:03.545419 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dc44e24f-b240-42d3-99c7-20f0543ec800 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:03.721232 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7544bd10-6ee9-4739-a07c-7a44f96fed0d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:03.723458 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7544bd10-6ee9-4739-a07c-7a44f96fed0d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:03.734547 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7544bd10-6ee9-4739-a07c-7a44f96fed0d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:03.735652 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7544bd10-6ee9-4739-a07c-7a44f96fed0d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:03.737066 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7544bd10-6ee9-4739-a07c-7a44f96fed0d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:03.737066 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7544bd10-6ee9-4739-a07c-7a44f96fed0d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:03.874127 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-dc44e24f-b240-42d3-99c7-20f0543ec800 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:03.882582 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-dc44e24f-b240-42d3-99c7-20f0543ec800 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1266 microversion: 2.1 time: 0.354282 Feb 20 20:11:03.883273 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 449/908] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:03 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1266 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:03.938699 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7544bd10-6ee9-4739-a07c-7a44f96fed0d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:03.948139 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7544bd10-6ee9-4739-a07c-7a44f96fed0d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:03.949663 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7544bd10-6ee9-4739-a07c-7a44f96fed0d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:03.950818 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7544bd10-6ee9-4739-a07c-7a44f96fed0d tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1730 microversion: 2.20 time: 0.235044 Feb 20 20:11:03.951393 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 460/909] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:11:03 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1730 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:11:04.900622 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-fbd19abe-1a98-4004-8dca-bb604839823f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:04.901500 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-fbd19abe-1a98-4004-8dca-bb604839823f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:04.911581 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fbd19abe-1a98-4004-8dca-bb604839823f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:04.912621 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fbd19abe-1a98-4004-8dca-bb604839823f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:04.913528 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fbd19abe-1a98-4004-8dca-bb604839823f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:04.914043 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fbd19abe-1a98-4004-8dca-bb604839823f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:04.970158 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9d8a004a-c78d-44cd-9ff8-8414546b9f78 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:04.973893 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9d8a004a-c78d-44cd-9ff8-8414546b9f78 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:04.978367 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9d8a004a-c78d-44cd-9ff8-8414546b9f78 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:04.979002 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9d8a004a-c78d-44cd-9ff8-8414546b9f78 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:04.979926 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9d8a004a-c78d-44cd-9ff8-8414546b9f78 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:04.980555 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9d8a004a-c78d-44cd-9ff8-8414546b9f78 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:05.122912 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-fbd19abe-1a98-4004-8dca-bb604839823f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:05.140300 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-fbd19abe-1a98-4004-8dca-bb604839823f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1266 microversion: 2.1 time: 0.244008 Feb 20 20:11:05.141606 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 450/910] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:04 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:05.195401 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9d8a004a-c78d-44cd-9ff8-8414546b9f78 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:05.204024 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9d8a004a-c78d-44cd-9ff8-8414546b9f78 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:05.205560 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9d8a004a-c78d-44cd-9ff8-8414546b9f78 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:05.206992 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9d8a004a-c78d-44cd-9ff8-8414546b9f78 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1730 microversion: 2.20 time: 0.240482 Feb 20 20:11:05.207586 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 461/911] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:11:04 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1730 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 20 20:11:06.159330 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5095e951-853e-45ae-88fc-92c056568711 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:06.160005 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5095e951-853e-45ae-88fc-92c056568711 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:06.171518 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5095e951-853e-45ae-88fc-92c056568711 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:06.173911 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5095e951-853e-45ae-88fc-92c056568711 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:06.177638 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5095e951-853e-45ae-88fc-92c056568711 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:06.178815 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5095e951-853e-45ae-88fc-92c056568711 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:06.231023 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-df33e851-ce71-4fb0-8340-3c01a9f90ea7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:06.237030 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-df33e851-ce71-4fb0-8340-3c01a9f90ea7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:06.241671 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-df33e851-ce71-4fb0-8340-3c01a9f90ea7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:06.242382 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-df33e851-ce71-4fb0-8340-3c01a9f90ea7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:06.244087 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-df33e851-ce71-4fb0-8340-3c01a9f90ea7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:06.244852 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-df33e851-ce71-4fb0-8340-3c01a9f90ea7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:06.397514 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5095e951-853e-45ae-88fc-92c056568711 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:06.406198 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5095e951-853e-45ae-88fc-92c056568711 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1266 microversion: 2.1 time: 0.249816 Feb 20 20:11:06.406447 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 451/912] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:06 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:06.485020 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-df33e851-ce71-4fb0-8340-3c01a9f90ea7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:06.497376 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-df33e851-ce71-4fb0-8340-3c01a9f90ea7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:06.501269 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-df33e851-ce71-4fb0-8340-3c01a9f90ea7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:06.503147 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-df33e851-ce71-4fb0-8340-3c01a9f90ea7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1730 microversion: 2.20 time: 0.279864 Feb 20 20:11:06.503898 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 462/913] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:11:06 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1730 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:11:07.040139 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 20 20:11:07.040139 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: Sun Feb 20 20:11:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 20 20:11:07.426816 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-78fa6c78-4ab8-4be5-838a-3b9d41d36101 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:07.427499 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-78fa6c78-4ab8-4be5-838a-3b9d41d36101 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:07.433909 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-78fa6c78-4ab8-4be5-838a-3b9d41d36101 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:07.434351 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-78fa6c78-4ab8-4be5-838a-3b9d41d36101 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:07.435410 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-78fa6c78-4ab8-4be5-838a-3b9d41d36101 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:07.435988 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-78fa6c78-4ab8-4be5-838a-3b9d41d36101 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:07.523510 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7cc45dc4-39e2-40bc-91ac-6085623ebccc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:07.524673 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7cc45dc4-39e2-40bc-91ac-6085623ebccc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:07.532158 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7cc45dc4-39e2-40bc-91ac-6085623ebccc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:07.532603 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7cc45dc4-39e2-40bc-91ac-6085623ebccc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:07.533606 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7cc45dc4-39e2-40bc-91ac-6085623ebccc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:07.534049 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7cc45dc4-39e2-40bc-91ac-6085623ebccc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:07.617887 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-78fa6c78-4ab8-4be5-838a-3b9d41d36101 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:07.626400 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-78fa6c78-4ab8-4be5-838a-3b9d41d36101 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1266 microversion: 2.1 time: 0.205805 Feb 20 20:11:07.627401 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 452/914] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:07 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:07.876523 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7cc45dc4-39e2-40bc-91ac-6085623ebccc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:07.891406 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7cc45dc4-39e2-40bc-91ac-6085623ebccc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:07.892907 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7cc45dc4-39e2-40bc-91ac-6085623ebccc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:07.894138 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7cc45dc4-39e2-40bc-91ac-6085623ebccc tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1717 microversion: 2.20 time: 0.375037 Feb 20 20:11:07.894691 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 463/915] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:11:07 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1717 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:11:08.653116 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5ccbb966-9d84-411a-98a9-7080ccfc83b7 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:08.653816 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5ccbb966-9d84-411a-98a9-7080ccfc83b7 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:08.666572 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5ccbb966-9d84-411a-98a9-7080ccfc83b7 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:08.666572 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5ccbb966-9d84-411a-98a9-7080ccfc83b7 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:08.666572 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5ccbb966-9d84-411a-98a9-7080ccfc83b7 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:08.666572 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5ccbb966-9d84-411a-98a9-7080ccfc83b7 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:08.831009 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5ccbb966-9d84-411a-98a9-7080ccfc83b7 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:08.840410 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5ccbb966-9d84-411a-98a9-7080ccfc83b7 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1266 microversion: 2.1 time: 0.191955 Feb 20 20:11:08.841040 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 453/916] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:08 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:09.859116 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c7f3d05f-1384-4f0d-beb1-68579a286004 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:09.859720 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c7f3d05f-1384-4f0d-beb1-68579a286004 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:09.866101 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c7f3d05f-1384-4f0d-beb1-68579a286004 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:09.866550 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c7f3d05f-1384-4f0d-beb1-68579a286004 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:09.867321 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c7f3d05f-1384-4f0d-beb1-68579a286004 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:09.867748 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c7f3d05f-1384-4f0d-beb1-68579a286004 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:10.051983 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c7f3d05f-1384-4f0d-beb1-68579a286004 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:10.058019 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c7f3d05f-1384-4f0d-beb1-68579a286004 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1266 microversion: 2.1 time: 0.202597 Feb 20 20:11:10.058582 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 464/917] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:09 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:11.075603 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-209e2d0a-6b6a-4f24-a1a5-87476a634e59 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:11.076352 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-209e2d0a-6b6a-4f24-a1a5-87476a634e59 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:11.083218 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-209e2d0a-6b6a-4f24-a1a5-87476a634e59 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:11.083662 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-209e2d0a-6b6a-4f24-a1a5-87476a634e59 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:11.084447 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-209e2d0a-6b6a-4f24-a1a5-87476a634e59 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:11.084879 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-209e2d0a-6b6a-4f24-a1a5-87476a634e59 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:11.259853 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-209e2d0a-6b6a-4f24-a1a5-87476a634e59 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:11.269617 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-209e2d0a-6b6a-4f24-a1a5-87476a634e59 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1266 microversion: 2.1 time: 0.197665 Feb 20 20:11:11.271354 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 454/918] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:11 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:12.292527 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-628a83ea-253a-400e-b3bf-9ceaafd6cc84 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:12.293482 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-628a83ea-253a-400e-b3bf-9ceaafd6cc84 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:12.303692 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-628a83ea-253a-400e-b3bf-9ceaafd6cc84 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:12.304177 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-628a83ea-253a-400e-b3bf-9ceaafd6cc84 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:12.305053 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-628a83ea-253a-400e-b3bf-9ceaafd6cc84 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:12.305668 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-628a83ea-253a-400e-b3bf-9ceaafd6cc84 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:12.493360 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-628a83ea-253a-400e-b3bf-9ceaafd6cc84 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:12.501206 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-628a83ea-253a-400e-b3bf-9ceaafd6cc84 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1266 microversion: 2.1 time: 0.213616 Feb 20 20:11:12.501718 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 465/919] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:12 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:13.526076 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f46ba722-39d8-4659-95b4-bdd8f5077626 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:13.526688 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f46ba722-39d8-4659-95b4-bdd8f5077626 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:13.533441 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f46ba722-39d8-4659-95b4-bdd8f5077626 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:13.533898 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f46ba722-39d8-4659-95b4-bdd8f5077626 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:13.534700 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f46ba722-39d8-4659-95b4-bdd8f5077626 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:13.535158 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f46ba722-39d8-4659-95b4-bdd8f5077626 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:13.706976 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f46ba722-39d8-4659-95b4-bdd8f5077626 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:13.718431 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f46ba722-39d8-4659-95b4-bdd8f5077626 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1266 microversion: 2.1 time: 0.196024 Feb 20 20:11:13.719033 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 455/920] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:13 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:11:14.736089 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2211b2dc-1eb6-44bd-bef4-af2161ee174e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:14.736687 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2211b2dc-1eb6-44bd-bef4-af2161ee174e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:14.743093 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2211b2dc-1eb6-44bd-bef4-af2161ee174e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:14.743533 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2211b2dc-1eb6-44bd-bef4-af2161ee174e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:14.744314 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2211b2dc-1eb6-44bd-bef4-af2161ee174e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:14.744755 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2211b2dc-1eb6-44bd-bef4-af2161ee174e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:14.902257 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2211b2dc-1eb6-44bd-bef4-af2161ee174e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:14.921832 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2211b2dc-1eb6-44bd-bef4-af2161ee174e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1266 microversion: 2.1 time: 0.189479 Feb 20 20:11:14.923117 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 466/921] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:14 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:15.200703 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-04bfacd1-5023-4afe-8a11-a2cc39d5d80e req-e135ced8-f418-4461-90a4-50d44b8d4473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c5dc901-3328-47a3-949d-97b1d3fd0f85", "name": "network-vif-plugged", "status": "completed", "tag": "9bb3be73-8f90-429e-b3c4-1a5cc212a013"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:11:15.203014 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:11:15.203014 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:11:15.224592 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-04bfacd1-5023-4afe-8a11-a2cc39d5d80e req-e135ced8-f418-4461-90a4-50d44b8d4473 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:15.225421 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-04bfacd1-5023-4afe-8a11-a2cc39d5d80e req-e135ced8-f418-4461-90a4-50d44b8d4473 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:15.240974 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-04bfacd1-5023-4afe-8a11-a2cc39d5d80e req-e135ced8-f418-4461-90a4-50d44b8d4473 service nova] Creating event network-vif-plugged:9bb3be73-8f90-429e-b3c4-1a5cc212a013 for instance 0c5dc901-3328-47a3-949d-97b1d3fd0f85 on hv-cinder-83008 Feb 20 20:11:15.246207 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-04bfacd1-5023-4afe-8a11-a2cc39d5d80e req-e135ced8-f418-4461-90a4-50d44b8d4473 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053003 Feb 20 20:11:15.246813 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 456/922] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:11:15.943828 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d43f68ce-29b0-47bb-84f1-5bd47d986906 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:15.944805 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d43f68ce-29b0-47bb-84f1-5bd47d986906 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:15.952470 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d43f68ce-29b0-47bb-84f1-5bd47d986906 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:15.952911 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d43f68ce-29b0-47bb-84f1-5bd47d986906 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:15.953734 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d43f68ce-29b0-47bb-84f1-5bd47d986906 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:15.954168 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d43f68ce-29b0-47bb-84f1-5bd47d986906 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:16.111011 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d43f68ce-29b0-47bb-84f1-5bd47d986906 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:16.119990 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d43f68ce-29b0-47bb-84f1-5bd47d986906 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1266 microversion: 2.1 time: 0.181629 Feb 20 20:11:16.120566 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 467/923] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:15 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:17.139609 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-0cec9e0d-84ca-463f-bb64-cad70dee2ed9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:17.140286 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-0cec9e0d-84ca-463f-bb64-cad70dee2ed9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:17.147262 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0cec9e0d-84ca-463f-bb64-cad70dee2ed9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:17.147826 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0cec9e0d-84ca-463f-bb64-cad70dee2ed9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:17.148903 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0cec9e0d-84ca-463f-bb64-cad70dee2ed9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:17.149681 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0cec9e0d-84ca-463f-bb64-cad70dee2ed9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:17.345066 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-0cec9e0d-84ca-463f-bb64-cad70dee2ed9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:17.354287 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-0cec9e0d-84ca-463f-bb64-cad70dee2ed9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1452 microversion: 2.1 time: 0.219150 Feb 20 20:11:17.359124 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 457/924] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:17 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1452 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:17.371318 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5710401d-c828-4fcd-8c50-f79e34b59c5a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:17.371923 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5710401d-c828-4fcd-8c50-f79e34b59c5a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:17.378169 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5710401d-c828-4fcd-8c50-f79e34b59c5a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:17.383145 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5710401d-c828-4fcd-8c50-f79e34b59c5a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:17.383145 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5710401d-c828-4fcd-8c50-f79e34b59c5a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:17.383145 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5710401d-c828-4fcd-8c50-f79e34b59c5a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:17.532033 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5710401d-c828-4fcd-8c50-f79e34b59c5a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:17.540032 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5710401d-c828-4fcd-8c50-f79e34b59c5a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1452 microversion: 2.1 time: 0.172427 Feb 20 20:11:17.540607 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 468/925] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:17 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:20.105551 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-188a0ee7-ba58-41b7-af93-fa23fdd0823d req-34b4f997-2008-43e9-a928-2ecd1cdd2f93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c5dc901-3328-47a3-949d-97b1d3fd0f85", "tag": "9bb3be73-8f90-429e-b3c4-1a5cc212a013"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:11:20.107081 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:11:20.107081 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:11:20.115486 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-188a0ee7-ba58-41b7-af93-fa23fdd0823d req-34b4f997-2008-43e9-a928-2ecd1cdd2f93 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:20.116009 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-188a0ee7-ba58-41b7-af93-fa23fdd0823d req-34b4f997-2008-43e9-a928-2ecd1cdd2f93 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:20.127329 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-188a0ee7-ba58-41b7-af93-fa23fdd0823d req-34b4f997-2008-43e9-a928-2ecd1cdd2f93 service nova] Creating event network-changed:9bb3be73-8f90-429e-b3c4-1a5cc212a013 for instance 0c5dc901-3328-47a3-949d-97b1d3fd0f85 on hv-cinder-83008 Feb 20 20:11:20.133494 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-188a0ee7-ba58-41b7-af93-fa23fdd0823d req-34b4f997-2008-43e9-a928-2ecd1cdd2f93 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031496 Feb 20 20:11:20.134313 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 458/926] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:11:34.061574 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-922152ee-5f18-4664-b6c9-63b7f5d3bf1a tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:34.062775 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-922152ee-5f18-4664-b6c9-63b7f5d3bf1a tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:34.070774 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-922152ee-5f18-4664-b6c9-63b7f5d3bf1a tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:34.071212 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-922152ee-5f18-4664-b6c9-63b7f5d3bf1a tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:34.071997 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-922152ee-5f18-4664-b6c9-63b7f5d3bf1a tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:34.072459 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-922152ee-5f18-4664-b6c9-63b7f5d3bf1a tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:34.105608 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-922152ee-5f18-4664-b6c9-63b7f5d3bf1a tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 20 20:11:34.403508 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-ec9508fa-7763-49aa-a8e4-a9f7256346ba req-13f631ff-a493-481f-8447-f04f9108fd36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19d0359-a8b7-4b10-9423-86e7bc401f0b", "tag": "24ada99e-5acc-483e-9242-a2920061f997"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:11:34.411832 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:11:34.411832 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:11:34.427196 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-ec9508fa-7763-49aa-a8e4-a9f7256346ba req-13f631ff-a493-481f-8447-f04f9108fd36 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:34.431299 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-ec9508fa-7763-49aa-a8e4-a9f7256346ba req-13f631ff-a493-481f-8447-f04f9108fd36 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:34.456840 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-ec9508fa-7763-49aa-a8e4-a9f7256346ba req-13f631ff-a493-481f-8447-f04f9108fd36 service nova] Creating event network-changed:24ada99e-5acc-483e-9242-a2920061f997 for instance e19d0359-a8b7-4b10-9423-86e7bc401f0b on hv-cinder-83008 Feb 20 20:11:34.467212 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-ec9508fa-7763-49aa-a8e4-a9f7256346ba req-13f631ff-a493-481f-8447-f04f9108fd36 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.384910 Feb 20 20:11:34.473340 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 459/927] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:11:34.493284 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-922152ee-5f18-4664-b6c9-63b7f5d3bf1a tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 204 len: 0 microversion: 2.1 time: 0.434800 Feb 20 20:11:34.494506 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 469/928] 10.222.0.60 () {58 vars in 1238 bytes} [Sun Feb 20 20:11:34 2022] DELETE /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 20 20:11:34.503899 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-32d7346e-64fe-4dbe-b08d-6adbac57f242 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:34.505716 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-32d7346e-64fe-4dbe-b08d-6adbac57f242 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:34.514158 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-32d7346e-64fe-4dbe-b08d-6adbac57f242 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:34.515422 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-32d7346e-64fe-4dbe-b08d-6adbac57f242 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:34.517195 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-32d7346e-64fe-4dbe-b08d-6adbac57f242 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:34.517975 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-32d7346e-64fe-4dbe-b08d-6adbac57f242 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:35.069577 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-32d7346e-64fe-4dbe-b08d-6adbac57f242 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:35.078467 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-32d7346e-64fe-4dbe-b08d-6adbac57f242 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1569 microversion: 2.1 time: 0.579195 Feb 20 20:11:35.079399 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 460/929] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:34 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1569 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:36.099511 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-24799586-b02e-4030-a94b-15bdc140be82 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:36.100479 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-24799586-b02e-4030-a94b-15bdc140be82 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:36.106731 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-24799586-b02e-4030-a94b-15bdc140be82 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:36.107181 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-24799586-b02e-4030-a94b-15bdc140be82 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:36.111338 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-24799586-b02e-4030-a94b-15bdc140be82 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:36.111338 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-24799586-b02e-4030-a94b-15bdc140be82 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:36.415944 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-24799586-b02e-4030-a94b-15bdc140be82 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:36.434637 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-24799586-b02e-4030-a94b-15bdc140be82 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1450 microversion: 2.1 time: 0.337987 Feb 20 20:11:36.434637 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 470/930] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:36 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1450 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:37.427015 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-3ca8dbe3-be2f-4de4-9b6a-7722c0ae39ce req-544fe0b1-5d43-4cb1-b201-5181a3e8a175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19d0359-a8b7-4b10-9423-86e7bc401f0b", "name": "network-vif-deleted", "tag": "24ada99e-5acc-483e-9242-a2920061f997"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:11:37.429057 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:11:37.429057 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:11:37.436543 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-3ca8dbe3-be2f-4de4-9b6a-7722c0ae39ce req-544fe0b1-5d43-4cb1-b201-5181a3e8a175 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:37.437005 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-3ca8dbe3-be2f-4de4-9b6a-7722c0ae39ce req-544fe0b1-5d43-4cb1-b201-5181a3e8a175 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:37.450724 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-388131de-f7d5-4aaa-b8cc-334dc3edfd70 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:37.454267 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-388131de-f7d5-4aaa-b8cc-334dc3edfd70 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:37.454395 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-3ca8dbe3-be2f-4de4-9b6a-7722c0ae39ce req-544fe0b1-5d43-4cb1-b201-5181a3e8a175 service nova] Creating event network-vif-deleted:24ada99e-5acc-483e-9242-a2920061f997 for instance e19d0359-a8b7-4b10-9423-86e7bc401f0b on hv-cinder-83008 Feb 20 20:11:37.457133 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-3ca8dbe3-be2f-4de4-9b6a-7722c0ae39ce req-544fe0b1-5d43-4cb1-b201-5181a3e8a175 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034097 Feb 20 20:11:37.458818 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 461/931] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:11:37.467917 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-388131de-f7d5-4aaa-b8cc-334dc3edfd70 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:37.468583 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-388131de-f7d5-4aaa-b8cc-334dc3edfd70 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:37.469605 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-388131de-f7d5-4aaa-b8cc-334dc3edfd70 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:37.470052 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-388131de-f7d5-4aaa-b8cc-334dc3edfd70 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:37.538330 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-388131de-f7d5-4aaa-b8cc-334dc3edfd70 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:37.555023 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-388131de-f7d5-4aaa-b8cc-334dc3edfd70 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1382 microversion: 2.1 time: 0.099817 Feb 20 20:11:37.555023 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 471/932] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:37 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1382 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:11:38.570291 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-44aed96f-8583-411a-a3e9-95b94d1a77d8 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:38.574522 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-44aed96f-8583-411a-a3e9-95b94d1a77d8 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:38.595261 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-44aed96f-8583-411a-a3e9-95b94d1a77d8 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:38.599073 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-44aed96f-8583-411a-a3e9-95b94d1a77d8 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:38.599073 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-44aed96f-8583-411a-a3e9-95b94d1a77d8 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:38.599073 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-44aed96f-8583-411a-a3e9-95b94d1a77d8 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:38.663619 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-44aed96f-8583-411a-a3e9-95b94d1a77d8 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:38.663902 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-44aed96f-8583-411a-a3e9-95b94d1a77d8 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:38.664336 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-44aed96f-8583-411a-a3e9-95b94d1a77d8 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lazy-loading 'fault' on Instance uuid e19d0359-a8b7-4b10-9423-86e7bc401f0b {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:11:38.724003 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-44aed96f-8583-411a-a3e9-95b94d1a77d8 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dadec92c12145649a5381cd0fd4c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e34338e9a48629be67b295d115a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:38.733177 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-44aed96f-8583-411a-a3e9-95b94d1a77d8 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 200 len: 1224 microversion: 2.1 time: 0.169027 Feb 20 20:11:38.734345 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 462/933] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:38 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 1224 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:39.507199 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-fc5feecb-d5cb-4fe8-8cb5-d876a9b3557d tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-548373507", "imageRef": "61c0cc70-53e3-40ed-b353-ec1b5fc4eea4", "flavorRef": "452", "networks": [{"uuid": "8f20c1af-3883-4ece-9b3a-a754941659c8"}]}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:11:39.568862 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.network.neutron [None req-fc5feecb-d5cb-4fe8-8cb5-d876a9b3557d tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] validate_networks() for [('8f20c1af-3883-4ece-9b3a-a754941659c8', None, None, None, None, None)] {{(pid=117088) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 20 20:11:39.761567 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6e3e62da-b380-4de9-9fd3-f54501414ba0 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:39.763292 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6e3e62da-b380-4de9-9fd3-f54501414ba0 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] [instance: e19d0359-a8b7-4b10-9423-86e7bc401f0b] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:39.769536 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6e3e62da-b380-4de9-9fd3-f54501414ba0 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:39.770604 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6e3e62da-b380-4de9-9fd3-f54501414ba0 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:39.771715 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6e3e62da-b380-4de9-9fd3-f54501414ba0 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:39.772323 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6e3e62da-b380-4de9-9fd3-f54501414ba0 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:39.789172 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-6e3e62da-b380-4de9-9fd3-f54501414ba0 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] HTTP exception thrown: Instance e19d0359-a8b7-4b10-9423-86e7bc401f0b could not be found. Feb 20 20:11:39.789981 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6e3e62da-b380-4de9-9fd3-f54501414ba0 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Returning 404 to user: Instance e19d0359-a8b7-4b10-9423-86e7bc401f0b could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:11:39.791192 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6e3e62da-b380-4de9-9fd3-f54501414ba0 tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b" status: 404 len: 111 microversion: 2.1 time: 0.033404 Feb 20 20:11:39.792293 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 463/934] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:39 2022] GET /compute/v2.1/servers/e19d0359-a8b7-4b10-9423-86e7bc401f0b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:11:39.979669 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-fc5feecb-d5cb-4fe8-8cb5-d876a9b3557d tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Flavor limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 20 20:11:39.980817 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-fc5feecb-d5cb-4fe8-8cb5-d876a9b3557d tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Image limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 20 20:11:39.981541 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-fc5feecb-d5cb-4fe8-8cb5-d876a9b3557d tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Flavor pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 20 20:11:39.982829 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-fc5feecb-d5cb-4fe8-8cb5-d876a9b3557d tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Image pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 20 20:11:39.983593 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-fc5feecb-d5cb-4fe8-8cb5-d876a9b3557d tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 20 20:11:39.994750 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fc5feecb-d5cb-4fe8-8cb5-d876a9b3557d tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:39.995652 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fc5feecb-d5cb-4fe8-8cb5-d876a9b3557d tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:39.996594 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fc5feecb-d5cb-4fe8-8cb5-d876a9b3557d tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:39.997190 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fc5feecb-d5cb-4fe8-8cb5-d876a9b3557d tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:40.018067 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-fc5feecb-d5cb-4fe8-8cb5-d876a9b3557d tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Getting quotas for project 808529e78f784dc883aa61be87436be2. Resources: {'instances', 'cores', 'ram'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:11:40.022366 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-fc5feecb-d5cb-4fe8-8cb5-d876a9b3557d tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Getting quotas for user 48726bef2dd64c6a89818ac908e20c7d and project 808529e78f784dc883aa61be87436be2. Resources: {'instances', 'cores', 'ram'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:11:40.043447 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-fc5feecb-d5cb-4fe8-8cb5-d876a9b3557d tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Going to run 1 instances... {{(pid=117088) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 20 20:11:40.046733 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-fc5feecb-d5cb-4fe8-8cb5-d876a9b3557d tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: b18afc74-8544-4a3d-8adf-1d7be316dee1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61c0cc70-53e3-40ed-b353-ec1b5fc4eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 20 20:11:40.241391 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-fc5feecb-d5cb-4fe8-8cb5-d876a9b3557d tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.737745 Feb 20 20:11:40.246493 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 472/935] 10.222.0.60 () {60 vars in 1146 bytes} [Sun Feb 20 20:11:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 20 20:11:40.268197 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ad223d22-71b7-4208-bb85-09e894893598 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:40.268197 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ad223d22-71b7-4208-bb85-09e894893598 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: b18afc74-8544-4a3d-8adf-1d7be316dee1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:40.278113 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9efc146b-f8ef-4523-9b7a-dd23652703ac tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] Calling method '.version_select at 0x7fdd91462d30>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:40.346510 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ad223d22-71b7-4208-bb85-09e894893598 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:40.352577 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ad223d22-71b7-4208-bb85-09e894893598 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1" status: 200 len: 1218 microversion: 2.1 time: 0.099741 Feb 20 20:11:40.362992 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 464/936] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:40 2022] GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:40.395673 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9efc146b-f8ef-4523-9b7a-dd23652703ac tempest-TestShelveInstance-609208763 tempest-TestShelveInstance-609208763-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1960512012" status: 202 len: 0 microversion: 2.1 time: 0.121466 Feb 20 20:11:40.397461 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 473/937] 10.222.0.60 () {58 vars in 1253 bytes} [Sun Feb 20 20:11:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1960512012 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 20 20:11:41.371197 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-bf1b8660-e54d-448a-bd3c-21f94cebc3e3 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:41.371818 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-bf1b8660-e54d-448a-bd3c-21f94cebc3e3 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: b18afc74-8544-4a3d-8adf-1d7be316dee1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:41.492131 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-bf1b8660-e54d-448a-bd3c-21f94cebc3e3 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:41.503912 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-bf1b8660-e54d-448a-bd3c-21f94cebc3e3 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1" status: 200 len: 1218 microversion: 2.1 time: 0.135947 Feb 20 20:11:41.505267 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 465/938] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:41 2022] GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1 => generated 1218 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:42.522964 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-183d4ce2-559d-4b7c-98dd-8e01582d782a tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:42.523880 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-183d4ce2-559d-4b7c-98dd-8e01582d782a tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: b18afc74-8544-4a3d-8adf-1d7be316dee1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:42.533996 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-183d4ce2-559d-4b7c-98dd-8e01582d782a tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:42.536254 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-183d4ce2-559d-4b7c-98dd-8e01582d782a tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:42.537847 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-183d4ce2-559d-4b7c-98dd-8e01582d782a tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:42.539146 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-183d4ce2-559d-4b7c-98dd-8e01582d782a tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:42.676551 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-183d4ce2-559d-4b7c-98dd-8e01582d782a tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:42.690371 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-183d4ce2-559d-4b7c-98dd-8e01582d782a tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1" status: 200 len: 1270 microversion: 2.1 time: 0.172550 Feb 20 20:11:42.693227 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 474/939] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:42 2022] GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1 => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:43.723113 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-190e0276-2008-467f-afb6-2b74326256b1 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:43.725283 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-190e0276-2008-467f-afb6-2b74326256b1 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: b18afc74-8544-4a3d-8adf-1d7be316dee1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:43.732669 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-190e0276-2008-467f-afb6-2b74326256b1 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:43.733549 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-190e0276-2008-467f-afb6-2b74326256b1 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:43.734928 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-190e0276-2008-467f-afb6-2b74326256b1 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:43.735542 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-190e0276-2008-467f-afb6-2b74326256b1 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:43.852377 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-190e0276-2008-467f-afb6-2b74326256b1 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:43.866445 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-190e0276-2008-467f-afb6-2b74326256b1 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1" status: 200 len: 1276 microversion: 2.1 time: 0.146245 Feb 20 20:11:43.870729 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 466/940] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:43 2022] GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1 => generated 1276 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:44.895256 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9c2dd262-46a3-41c8-8b20-a18a6d6810df tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:44.895256 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9c2dd262-46a3-41c8-8b20-a18a6d6810df tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: b18afc74-8544-4a3d-8adf-1d7be316dee1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:44.895995 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9c2dd262-46a3-41c8-8b20-a18a6d6810df tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:44.895995 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9c2dd262-46a3-41c8-8b20-a18a6d6810df tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:44.896689 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9c2dd262-46a3-41c8-8b20-a18a6d6810df tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:44.897247 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9c2dd262-46a3-41c8-8b20-a18a6d6810df tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:45.563434 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9c2dd262-46a3-41c8-8b20-a18a6d6810df tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:45.576192 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9c2dd262-46a3-41c8-8b20-a18a6d6810df tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1" status: 200 len: 1318 microversion: 2.1 time: 0.690470 Feb 20 20:11:45.577066 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 475/941] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:44 2022] GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1 => generated 1318 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:46.438466 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-207ac8eb-a800-4a0e-9860-222dfb063a98 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:46.439507 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-207ac8eb-a800-4a0e-9860-222dfb063a98 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:46.451592 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-207ac8eb-a800-4a0e-9860-222dfb063a98 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:46.454720 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-207ac8eb-a800-4a0e-9860-222dfb063a98 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:46.454720 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-207ac8eb-a800-4a0e-9860-222dfb063a98 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:46.454720 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-207ac8eb-a800-4a0e-9860-222dfb063a98 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:46.502639 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-207ac8eb-a800-4a0e-9860-222dfb063a98 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.069628 Feb 20 20:11:46.508757 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 467/942] 10.222.0.60 () {60 vars in 1342 bytes} [Sun Feb 20 20:11:46 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:46.572179 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ff588dd3-b83d-4263-b8ad-279efd9a3140 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:46.573289 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ff588dd3-b83d-4263-b8ad-279efd9a3140 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:46.580608 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ff588dd3-b83d-4263-b8ad-279efd9a3140 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:46.581932 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ff588dd3-b83d-4263-b8ad-279efd9a3140 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:46.586027 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ff588dd3-b83d-4263-b8ad-279efd9a3140 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:46.587199 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-ff588dd3-b83d-4263-b8ad-279efd9a3140 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:46.602096 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f5e42749-7041-49bb-ad53-d4d1462c74a4 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:46.602712 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f5e42749-7041-49bb-ad53-d4d1462c74a4 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: b18afc74-8544-4a3d-8adf-1d7be316dee1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:46.619274 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f5e42749-7041-49bb-ad53-d4d1462c74a4 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:46.620033 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f5e42749-7041-49bb-ad53-d4d1462c74a4 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:46.624646 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f5e42749-7041-49bb-ad53-d4d1462c74a4 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:46.625590 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f5e42749-7041-49bb-ad53-d4d1462c74a4 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:46.676057 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-ff588dd3-b83d-4263-b8ad-279efd9a3140 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 20 20:11:46.951709 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-f5e42749-7041-49bb-ad53-d4d1462c74a4 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:46.966848 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f5e42749-7041-49bb-ad53-d4d1462c74a4 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1" status: 200 len: 1318 microversion: 2.1 time: 0.371378 Feb 20 20:11:46.968683 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 468/943] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:46 2022] GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1 => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:46.999987 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-51e1c960-33ca-4a7f-a6d8-c49de20679e4 req-bf55bace-6ba7-4416-9994-4d7e345fa1af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b18afc74-8544-4a3d-8adf-1d7be316dee1", "tag": "dba3326e-02ac-4d68-a8a5-60f820ed9d96"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:11:47.005177 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:11:47.005177 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:11:47.013594 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-51e1c960-33ca-4a7f-a6d8-c49de20679e4 req-bf55bace-6ba7-4416-9994-4d7e345fa1af service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:47.014583 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-51e1c960-33ca-4a7f-a6d8-c49de20679e4 req-bf55bace-6ba7-4416-9994-4d7e345fa1af service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:47.032655 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-51e1c960-33ca-4a7f-a6d8-c49de20679e4 req-bf55bace-6ba7-4416-9994-4d7e345fa1af service nova] Creating event network-changed:dba3326e-02ac-4d68-a8a5-60f820ed9d96 for instance b18afc74-8544-4a3d-8adf-1d7be316dee1 on hv-cinder-83008 Feb 20 20:11:47.039011 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-51e1c960-33ca-4a7f-a6d8-c49de20679e4 req-bf55bace-6ba7-4416-9994-4d7e345fa1af service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044600 Feb 20 20:11:47.041005 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 469/944] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:11:47.121729 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ff588dd3-b83d-4263-b8ad-279efd9a3140 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 204 len: 0 microversion: 2.20 time: 0.554333 Feb 20 20:11:47.133141 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4a25bb35-e479-4693-9c04-a906dcc2fa10 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:47.133754 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4a25bb35-e479-4693-9c04-a906dcc2fa10 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:47.133888 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 476/945] 10.222.0.60 () {60 vars in 1279 bytes} [Sun Feb 20 20:11:46 2022] DELETE /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 20 20:11:47.149600 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4a25bb35-e479-4693-9c04-a906dcc2fa10 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:47.151210 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4a25bb35-e479-4693-9c04-a906dcc2fa10 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:47.152049 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4a25bb35-e479-4693-9c04-a906dcc2fa10 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:47.154198 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4a25bb35-e479-4693-9c04-a906dcc2fa10 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:47.537430 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4a25bb35-e479-4693-9c04-a906dcc2fa10 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:47.554755 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4a25bb35-e479-4693-9c04-a906dcc2fa10 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:47.561700 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4a25bb35-e479-4693-9c04-a906dcc2fa10 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:47.563825 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4a25bb35-e479-4693-9c04-a906dcc2fa10 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1723 microversion: 2.20 time: 0.436021 Feb 20 20:11:47.564575 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 470/946] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:11:47 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1723 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:11:47.986538 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-de5dd7f3-f9a6-45a2-8606-fe2f821f0213 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:47.987465 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-de5dd7f3-f9a6-45a2-8606-fe2f821f0213 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: b18afc74-8544-4a3d-8adf-1d7be316dee1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:47.995449 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-de5dd7f3-f9a6-45a2-8606-fe2f821f0213 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:47.996147 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-de5dd7f3-f9a6-45a2-8606-fe2f821f0213 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:47.997308 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-de5dd7f3-f9a6-45a2-8606-fe2f821f0213 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:47.997906 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-de5dd7f3-f9a6-45a2-8606-fe2f821f0213 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:48.287021 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-de5dd7f3-f9a6-45a2-8606-fe2f821f0213 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:48.296236 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-de5dd7f3-f9a6-45a2-8606-fe2f821f0213 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1" status: 200 len: 1318 microversion: 2.1 time: 0.313960 Feb 20 20:11:48.299321 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 477/947] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:47 2022] GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:48.585237 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5a08d38f-41ba-4648-bac8-df24808bf8c6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:48.586027 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5a08d38f-41ba-4648-bac8-df24808bf8c6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:48.602756 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5a08d38f-41ba-4648-bac8-df24808bf8c6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:48.603207 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5a08d38f-41ba-4648-bac8-df24808bf8c6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:48.605290 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5a08d38f-41ba-4648-bac8-df24808bf8c6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:48.606668 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5a08d38f-41ba-4648-bac8-df24808bf8c6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:49.315970 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2ad753d3-749c-4e23-b5a8-cf0db0d0602f tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:49.318722 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2ad753d3-749c-4e23-b5a8-cf0db0d0602f tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: b18afc74-8544-4a3d-8adf-1d7be316dee1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:49.330027 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2ad753d3-749c-4e23-b5a8-cf0db0d0602f tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:49.330799 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2ad753d3-749c-4e23-b5a8-cf0db0d0602f tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:49.331829 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2ad753d3-749c-4e23-b5a8-cf0db0d0602f tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:49.349606 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2ad753d3-749c-4e23-b5a8-cf0db0d0602f tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:49.515457 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5a08d38f-41ba-4648-bac8-df24808bf8c6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:49.535148 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5a08d38f-41ba-4648-bac8-df24808bf8c6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:49.537311 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5a08d38f-41ba-4648-bac8-df24808bf8c6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:49.538772 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5a08d38f-41ba-4648-bac8-df24808bf8c6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1723 microversion: 2.20 time: 0.959668 Feb 20 20:11:49.556053 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 471/948] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:11:48 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1723 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:11:49.900477 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2ad753d3-749c-4e23-b5a8-cf0db0d0602f tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:49.908920 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2ad753d3-749c-4e23-b5a8-cf0db0d0602f tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1" status: 200 len: 1318 microversion: 2.1 time: 0.596401 Feb 20 20:11:49.918842 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 478/949] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:49 2022] GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1 => generated 1318 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:50.565519 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6b81db6c-c051-43c3-9d65-56ed46b642ec tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:50.567523 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6b81db6c-c051-43c3-9d65-56ed46b642ec tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:50.588029 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6b81db6c-c051-43c3-9d65-56ed46b642ec tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:50.599085 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6b81db6c-c051-43c3-9d65-56ed46b642ec tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:50.601635 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6b81db6c-c051-43c3-9d65-56ed46b642ec tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:50.602535 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6b81db6c-c051-43c3-9d65-56ed46b642ec tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:50.927345 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d158c048-5375-4c02-8222-26a5d584ecf5 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:50.928149 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d158c048-5375-4c02-8222-26a5d584ecf5 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: b18afc74-8544-4a3d-8adf-1d7be316dee1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:50.944758 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d158c048-5375-4c02-8222-26a5d584ecf5 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:50.945395 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d158c048-5375-4c02-8222-26a5d584ecf5 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:50.948217 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d158c048-5375-4c02-8222-26a5d584ecf5 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:50.948793 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d158c048-5375-4c02-8222-26a5d584ecf5 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:51.206028 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6b81db6c-c051-43c3-9d65-56ed46b642ec tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:51.225291 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6b81db6c-c051-43c3-9d65-56ed46b642ec tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:51.227478 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6b81db6c-c051-43c3-9d65-56ed46b642ec tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:51.228909 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6b81db6c-c051-43c3-9d65-56ed46b642ec tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1723 microversion: 2.20 time: 0.671564 Feb 20 20:11:51.245246 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 472/950] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:11:50 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1723 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:11:51.476785 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d158c048-5375-4c02-8222-26a5d584ecf5 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:51.485030 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d158c048-5375-4c02-8222-26a5d584ecf5 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1" status: 200 len: 1318 microversion: 2.1 time: 0.562948 Feb 20 20:11:51.491972 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 479/951] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:50 2022] GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1 => generated 1318 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:11:51.818770 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-02700d4a-e054-4734-a328-6b502a4a0291 req-fd3ee014-658d-47a5-93b6-d7e040f8f6ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f60f31-e3e4-4705-910a-d01bdba1d965", "name": "network-vif-deleted", "tag": "1a899be1-fae4-4e55-ab37-e5b2c436daf0"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:11:51.821258 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:11:51.821258 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:11:51.839817 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-02700d4a-e054-4734-a328-6b502a4a0291 req-fd3ee014-658d-47a5-93b6-d7e040f8f6ac service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:51.840913 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-02700d4a-e054-4734-a328-6b502a4a0291 req-fd3ee014-658d-47a5-93b6-d7e040f8f6ac service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:51.865354 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-02700d4a-e054-4734-a328-6b502a4a0291 req-fd3ee014-658d-47a5-93b6-d7e040f8f6ac service nova] Creating event network-vif-deleted:1a899be1-fae4-4e55-ab37-e5b2c436daf0 for instance d2f60f31-e3e4-4705-910a-d01bdba1d965 on hv-cinder-83008 Feb 20 20:11:51.873024 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-02700d4a-e054-4734-a328-6b502a4a0291 req-fd3ee014-658d-47a5-93b6-d7e040f8f6ac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068213 Feb 20 20:11:51.879766 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 473/952] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:11:52.248266 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-dff821ac-dd15-4af9-be94-b2c1820aa8d6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:52.249036 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-dff821ac-dd15-4af9-be94-b2c1820aa8d6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:52.257213 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dff821ac-dd15-4af9-be94-b2c1820aa8d6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:52.259967 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dff821ac-dd15-4af9-be94-b2c1820aa8d6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:52.262693 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dff821ac-dd15-4af9-be94-b2c1820aa8d6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:52.264994 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dff821ac-dd15-4af9-be94-b2c1820aa8d6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:52.315968 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dff821ac-dd15-4af9-be94-b2c1820aa8d6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:52.317376 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dff821ac-dd15-4af9-be94-b2c1820aa8d6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:52.318054 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-dff821ac-dd15-4af9-be94-b2c1820aa8d6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lazy-loading 'fault' on Instance uuid d2f60f31-e3e4-4705-910a-d01bdba1d965 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:11:52.380686 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-dff821ac-dd15-4af9-be94-b2c1820aa8d6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:52.413738 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-dff821ac-dd15-4af9-be94-b2c1820aa8d6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:52.418732 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-dff821ac-dd15-4af9-be94-b2c1820aa8d6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a2f5fd619ad45a48590fa6b2ae6fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bbd53d77c94e618e7f59de051406ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:52.423252 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-dff821ac-dd15-4af9-be94-b2c1820aa8d6 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 200 len: 1370 microversion: 2.20 time: 0.178774 Feb 20 20:11:52.424577 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 480/953] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:11:52 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 20 20:11:52.515387 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7169e6ee-6112-4837-a66a-28b724529544 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:52.516214 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7169e6ee-6112-4837-a66a-28b724529544 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: b18afc74-8544-4a3d-8adf-1d7be316dee1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:52.526059 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7169e6ee-6112-4837-a66a-28b724529544 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:52.530460 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7169e6ee-6112-4837-a66a-28b724529544 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:52.535839 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7169e6ee-6112-4837-a66a-28b724529544 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:52.538997 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7169e6ee-6112-4837-a66a-28b724529544 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:52.948600 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7169e6ee-6112-4837-a66a-28b724529544 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:52.958456 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7169e6ee-6112-4837-a66a-28b724529544 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1" status: 200 len: 1318 microversion: 2.1 time: 0.447599 Feb 20 20:11:52.977126 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 474/954] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:52 2022] GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1 => generated 1318 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:53.446725 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-35a25450-149b-41b7-83a8-7458fdac851f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:53.448106 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-35a25450-149b-41b7-83a8-7458fdac851f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:53.457825 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-35a25450-149b-41b7-83a8-7458fdac851f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:53.459484 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-35a25450-149b-41b7-83a8-7458fdac851f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:53.459899 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-35a25450-149b-41b7-83a8-7458fdac851f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:53.460589 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-35a25450-149b-41b7-83a8-7458fdac851f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:53.514539 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-35a25450-149b-41b7-83a8-7458fdac851f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] HTTP exception thrown: Instance d2f60f31-e3e4-4705-910a-d01bdba1d965 could not be found. Feb 20 20:11:53.515423 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-35a25450-149b-41b7-83a8-7458fdac851f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Returning 404 to user: Instance d2f60f31-e3e4-4705-910a-d01bdba1d965 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:11:53.516462 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-35a25450-149b-41b7-83a8-7458fdac851f tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 404 len: 111 microversion: 2.20 time: 0.076392 Feb 20 20:11:53.517985 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 481/955] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:11:53 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 20 20:11:53.543483 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-855a0789-0b8a-4228-9dfe-ff2a5ea4c2e7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '.version_select at 0x7fdd91465c10>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:53.665527 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-0787736d-84fa-404f-96a0-1d310366b0e3 req-9a1887fb-481b-4f59-a629-0b42dddcebf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b18afc74-8544-4a3d-8adf-1d7be316dee1", "name": "network-vif-plugged", "status": "completed", "tag": "dba3326e-02ac-4d68-a8a5-60f820ed9d96"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:11:53.668193 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:11:53.668193 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:11:53.679806 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-0787736d-84fa-404f-96a0-1d310366b0e3 req-9a1887fb-481b-4f59-a629-0b42dddcebf5 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:53.679806 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-0787736d-84fa-404f-96a0-1d310366b0e3 req-9a1887fb-481b-4f59-a629-0b42dddcebf5 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:53.695652 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-0787736d-84fa-404f-96a0-1d310366b0e3 req-9a1887fb-481b-4f59-a629-0b42dddcebf5 service nova] Creating event network-vif-plugged:dba3326e-02ac-4d68-a8a5-60f820ed9d96 for instance b18afc74-8544-4a3d-8adf-1d7be316dee1 on hv-cinder-83008 Feb 20 20:11:53.702011 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-0787736d-84fa-404f-96a0-1d310366b0e3 req-9a1887fb-481b-4f59-a629-0b42dddcebf5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042403 Feb 20 20:11:53.702775 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 482/956] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:11:53.944992 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-855a0789-0b8a-4228-9dfe-ff2a5ea4c2e7 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-747536135" status: 204 len: 0 microversion: 2.20 time: 0.415156 Feb 20 20:11:53.945639 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 475/957] 10.222.0.60 () {60 vars in 1258 bytes} [Sun Feb 20 20:11:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-747536135 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 20 20:11:54.006782 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-1f162fa8-2f1a-4dfd-b4ac-f8c8847bc299 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:54.007509 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-1f162fa8-2f1a-4dfd-b4ac-f8c8847bc299 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: b18afc74-8544-4a3d-8adf-1d7be316dee1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:54.032391 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1f162fa8-2f1a-4dfd-b4ac-f8c8847bc299 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:54.039603 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1f162fa8-2f1a-4dfd-b4ac-f8c8847bc299 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:54.040529 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1f162fa8-2f1a-4dfd-b4ac-f8c8847bc299 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:54.041122 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-1f162fa8-2f1a-4dfd-b4ac-f8c8847bc299 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:54.575426 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-1f162fa8-2f1a-4dfd-b4ac-f8c8847bc299 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:54.603449 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-1f162fa8-2f1a-4dfd-b4ac-f8c8847bc299 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1" status: 200 len: 1318 microversion: 2.1 time: 0.623651 Feb 20 20:11:54.604720 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 483/958] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:53 2022] GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1 => generated 1318 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:55.621719 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2dd05b89-40f7-4445-9d50-a2d9579f29f2 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:55.622424 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2dd05b89-40f7-4445-9d50-a2d9579f29f2 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: b18afc74-8544-4a3d-8adf-1d7be316dee1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:55.645148 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2dd05b89-40f7-4445-9d50-a2d9579f29f2 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:55.646064 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2dd05b89-40f7-4445-9d50-a2d9579f29f2 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:55.646697 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2dd05b89-40f7-4445-9d50-a2d9579f29f2 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:55.646816 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2dd05b89-40f7-4445-9d50-a2d9579f29f2 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:55.875388 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2dd05b89-40f7-4445-9d50-a2d9579f29f2 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:55.890419 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2dd05b89-40f7-4445-9d50-a2d9579f29f2 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1" status: 200 len: 1318 microversion: 2.1 time: 0.273246 Feb 20 20:11:55.892146 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 476/959] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:55 2022] GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:56.907769 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-85339e81-3f10-43b4-b10e-567804f1cb04 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:56.909729 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-85339e81-3f10-43b4-b10e-567804f1cb04 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: b18afc74-8544-4a3d-8adf-1d7be316dee1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:56.918867 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-85339e81-3f10-43b4-b10e-567804f1cb04 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:56.920003 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-85339e81-3f10-43b4-b10e-567804f1cb04 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:56.921682 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-85339e81-3f10-43b4-b10e-567804f1cb04 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:56.922993 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-85339e81-3f10-43b4-b10e-567804f1cb04 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:57.026645 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-67b88acb-819c-4957-bbe0-0c613bb44271 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:57.027862 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-67b88acb-819c-4957-bbe0-0c613bb44271 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:57.036303 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-67b88acb-819c-4957-bbe0-0c613bb44271 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:57.036861 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-67b88acb-819c-4957-bbe0-0c613bb44271 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:57.037738 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-67b88acb-819c-4957-bbe0-0c613bb44271 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:57.038393 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-67b88acb-819c-4957-bbe0-0c613bb44271 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:57.053584 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-67b88acb-819c-4957-bbe0-0c613bb44271 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] HTTP exception thrown: Instance d2f60f31-e3e4-4705-910a-d01bdba1d965 could not be found. Feb 20 20:11:57.054527 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-67b88acb-819c-4957-bbe0-0c613bb44271 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Returning 404 to user: Instance d2f60f31-e3e4-4705-910a-d01bdba1d965 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:11:57.055537 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-67b88acb-819c-4957-bbe0-0c613bb44271 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 404 len: 111 microversion: 2.20 time: 0.032664 Feb 20 20:11:57.059622 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 477/960] 10.222.0.60 () {60 vars in 1279 bytes} [Sun Feb 20 20:11:57 2022] DELETE /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 20 20:11:57.064362 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-0841b462-278e-4740-b7ed-6ee645a1414b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:57.065207 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-0841b462-278e-4740-b7ed-6ee645a1414b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d2f60f31-e3e4-4705-910a-d01bdba1d965] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:57.072313 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0841b462-278e-4740-b7ed-6ee645a1414b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:57.073129 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0841b462-278e-4740-b7ed-6ee645a1414b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:57.074087 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0841b462-278e-4740-b7ed-6ee645a1414b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:57.074689 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0841b462-278e-4740-b7ed-6ee645a1414b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:57.090222 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-0841b462-278e-4740-b7ed-6ee645a1414b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] HTTP exception thrown: Instance d2f60f31-e3e4-4705-910a-d01bdba1d965 could not be found. Feb 20 20:11:57.094429 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-0841b462-278e-4740-b7ed-6ee645a1414b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Returning 404 to user: Instance d2f60f31-e3e4-4705-910a-d01bdba1d965 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:11:57.098198 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-0841b462-278e-4740-b7ed-6ee645a1414b tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965" status: 404 len: 111 microversion: 2.20 time: 0.035220 Feb 20 20:11:57.102241 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 478/961] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:11:57 2022] GET /compute/v2.1/servers/d2f60f31-e3e4-4705-910a-d01bdba1d965 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 20 20:11:57.257728 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-85339e81-3f10-43b4-b10e-567804f1cb04 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:11:57.268231 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-85339e81-3f10-43b4-b10e-567804f1cb04 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1" status: 200 len: 1508 microversion: 2.1 time: 0.364213 Feb 20 20:11:57.268873 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 484/962] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:11:56 2022] GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1 => generated 1508 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:11:58.418598 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a96185ef-7ef7-47f1-ac89-4ce84f9d6ef8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:58.419247 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a96185ef-7ef7-47f1-ac89-4ce84f9d6ef8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:58.426802 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a96185ef-7ef7-47f1-ac89-4ce84f9d6ef8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:58.427259 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a96185ef-7ef7-47f1-ac89-4ce84f9d6ef8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:58.428053 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a96185ef-7ef7-47f1-ac89-4ce84f9d6ef8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:58.428490 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a96185ef-7ef7-47f1-ac89-4ce84f9d6ef8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:58.446559 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-a96185ef-7ef7-47f1-ac89-4ce84f9d6ef8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] HTTP exception thrown: Instance d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 could not be found. Feb 20 20:11:58.446559 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a96185ef-7ef7-47f1-ac89-4ce84f9d6ef8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Returning 404 to user: Instance d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:11:58.446559 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a96185ef-7ef7-47f1-ac89-4ce84f9d6ef8 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 404 len: 111 microversion: 2.20 time: 0.030954 Feb 20 20:11:58.447030 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 479/963] 10.222.0.60 () {60 vars in 1279 bytes} [Sun Feb 20 20:11:58 2022] DELETE /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 20 20:11:58.460448 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-844c16c0-d6d1-4f23-8952-c10734917d65 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:11:58.461682 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-844c16c0-d6d1-4f23-8952-c10734917d65 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] [instance: d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:11:58.476317 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-844c16c0-d6d1-4f23-8952-c10734917d65 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:58.477293 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-844c16c0-d6d1-4f23-8952-c10734917d65 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:58.478885 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-844c16c0-d6d1-4f23-8952-c10734917d65 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:11:58.479840 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-844c16c0-d6d1-4f23-8952-c10734917d65 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:11:58.506462 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-844c16c0-d6d1-4f23-8952-c10734917d65 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] HTTP exception thrown: Instance d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 could not be found. Feb 20 20:11:58.507333 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-844c16c0-d6d1-4f23-8952-c10734917d65 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] Returning 404 to user: Instance d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:11:58.508628 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-844c16c0-d6d1-4f23-8952-c10734917d65 tempest-AttachVolumeShelveTestJSON-1524082140 tempest-AttachVolumeShelveTestJSON-1524082140-project] 10.222.0.60 "GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97" status: 404 len: 111 microversion: 2.20 time: 0.056138 Feb 20 20:11:58.509196 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 485/964] 10.222.0.60 () {60 vars in 1276 bytes} [Sun Feb 20 20:11:58 2022] GET /compute/v2.1/servers/d14eb2eb-57c9-4ca9-9c8e-2a9dd41a4f97 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 20 20:12:02.899475 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b7b3cca4-fbfa-44f9-8f68-033d25d94179 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Action: 'create', calling method: .version_select at 0x7fdd91445ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-618810537"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:12:02.930874 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-b7b3cca4-fbfa-44f9-8f68-033d25d94179 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Getting quotas for project c045506d99f44170a1ba8efc46b78ddc. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:12:02.943317 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-b7b3cca4-fbfa-44f9-8f68-033d25d94179 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Getting quotas for user 115f83923a084af2a813b977f2457834 and project c045506d99f44170a1ba8efc46b78ddc. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:12:03.303825 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-b7b3cca4-fbfa-44f9-8f68-033d25d94179 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Getting quotas for project c045506d99f44170a1ba8efc46b78ddc. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:12:03.314790 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-b7b3cca4-fbfa-44f9-8f68-033d25d94179 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Getting quotas for user 115f83923a084af2a813b977f2457834 and project c045506d99f44170a1ba8efc46b78ddc. Resources: {'key_pairs'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:12:03.338982 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b7b3cca4-fbfa-44f9-8f68-033d25d94179 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.445589 Feb 20 20:12:03.340575 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 480/965] 10.222.0.60 () {60 vars in 1157 bytes} [Sun Feb 20 20:12:02 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:12:03.509404 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-535cf0c2-2fb1-462e-95be-c7746899ff80 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1062520783", "imageRef": "bb890035-f8bb-4abb-b144-5efd12e55288", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-618810537", "networks": [{"uuid": "db8c8873-7f1b-493a-86af-596216e0a763"}]}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:12:03.629932 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.network.neutron [None req-535cf0c2-2fb1-462e-95be-c7746899ff80 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] validate_networks() for [('db8c8873-7f1b-493a-86af-596216e0a763', None, None, None, None, None)] {{(pid=117088) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 20 20:12:04.274540 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-535cf0c2-2fb1-462e-95be-c7746899ff80 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Flavor limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 20 20:12:04.275699 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-535cf0c2-2fb1-462e-95be-c7746899ff80 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Image limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 20 20:12:04.276595 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-535cf0c2-2fb1-462e-95be-c7746899ff80 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Flavor pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 20 20:12:04.277359 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-535cf0c2-2fb1-462e-95be-c7746899ff80 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Image pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 20 20:12:04.277915 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-535cf0c2-2fb1-462e-95be-c7746899ff80 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 20 20:12:04.288675 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-535cf0c2-2fb1-462e-95be-c7746899ff80 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:04.289156 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-535cf0c2-2fb1-462e-95be-c7746899ff80 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:04.289975 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-535cf0c2-2fb1-462e-95be-c7746899ff80 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:04.290416 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-535cf0c2-2fb1-462e-95be-c7746899ff80 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:04.311902 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-535cf0c2-2fb1-462e-95be-c7746899ff80 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Getting quotas for project c045506d99f44170a1ba8efc46b78ddc. Resources: {'instances', 'cores', 'ram'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:12:04.317108 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-535cf0c2-2fb1-462e-95be-c7746899ff80 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Getting quotas for user 115f83923a084af2a813b977f2457834 and project c045506d99f44170a1ba8efc46b78ddc. Resources: {'instances', 'cores', 'ram'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:12:04.329879 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-535cf0c2-2fb1-462e-95be-c7746899ff80 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Going to run 1 instances... {{(pid=117088) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 20 20:12:04.334595 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-535cf0c2-2fb1-462e-95be-c7746899ff80 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb890035-f8bb-4abb-b144-5efd12e55288',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 20 20:12:04.522864 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-535cf0c2-2fb1-462e-95be-c7746899ff80 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.020704 Feb 20 20:12:04.523706 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 486/966] 10.222.0.60 () {60 vars in 1146 bytes} [Sun Feb 20 20:12:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 20 20:12:04.534494 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9c15d2af-a237-42f8-96e2-9cdd50dc3a1e tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:04.535959 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9c15d2af-a237-42f8-96e2-9cdd50dc3a1e tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:04.604510 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-9c15d2af-a237-42f8-96e2-9cdd50dc3a1e tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:04.618308 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9c15d2af-a237-42f8-96e2-9cdd50dc3a1e tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1258 microversion: 2.1 time: 0.088089 Feb 20 20:12:04.619174 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 481/967] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:04 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1258 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:12:05.642554 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-415022ab-9d6d-476a-bb55-5887d48bd1cb tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:05.643795 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-415022ab-9d6d-476a-bb55-5887d48bd1cb tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:05.717050 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-415022ab-9d6d-476a-bb55-5887d48bd1cb tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:05.724985 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-415022ab-9d6d-476a-bb55-5887d48bd1cb tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1258 microversion: 2.1 time: 0.089163 Feb 20 20:12:05.725691 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 487/968] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:05 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1258 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:12:06.741427 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-fb7ba572-f74a-4d75-b511-6ef5dc0ae637 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:06.742911 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-fb7ba572-f74a-4d75-b511-6ef5dc0ae637 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:06.749929 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fb7ba572-f74a-4d75-b511-6ef5dc0ae637 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:06.750374 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fb7ba572-f74a-4d75-b511-6ef5dc0ae637 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:06.751456 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fb7ba572-f74a-4d75-b511-6ef5dc0ae637 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:06.751973 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fb7ba572-f74a-4d75-b511-6ef5dc0ae637 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:06.829791 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-fb7ba572-f74a-4d75-b511-6ef5dc0ae637 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:06.844936 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-fb7ba572-f74a-4d75-b511-6ef5dc0ae637 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1310 microversion: 2.1 time: 0.107492 Feb 20 20:12:06.845587 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 482/969] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:06 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1310 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:07.870636 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4686b78c-41d6-4108-a308-45176299e601 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:07.874726 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4686b78c-41d6-4108-a308-45176299e601 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:07.879691 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4686b78c-41d6-4108-a308-45176299e601 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:07.881132 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4686b78c-41d6-4108-a308-45176299e601 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:07.881132 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4686b78c-41d6-4108-a308-45176299e601 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:07.881717 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4686b78c-41d6-4108-a308-45176299e601 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:07.981858 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4686b78c-41d6-4108-a308-45176299e601 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:07.990180 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4686b78c-41d6-4108-a308-45176299e601 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1318 microversion: 2.1 time: 0.123376 Feb 20 20:12:07.991389 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 488/970] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:07 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1318 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:09.014062 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4521104d-248a-4803-be05-95964bfe3025 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:09.031976 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4521104d-248a-4803-be05-95964bfe3025 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:09.031976 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4521104d-248a-4803-be05-95964bfe3025 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:09.031976 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4521104d-248a-4803-be05-95964bfe3025 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:09.031976 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4521104d-248a-4803-be05-95964bfe3025 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:09.035441 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4521104d-248a-4803-be05-95964bfe3025 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:09.624665 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4521104d-248a-4803-be05-95964bfe3025 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:09.644261 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4521104d-248a-4803-be05-95964bfe3025 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1358 microversion: 2.1 time: 0.639270 Feb 20 20:12:09.658410 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 483/971] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:09 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1358 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:10.570103 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-d74fb837-2157-4f8f-b3a9-32531789ef4e req-98cfddb7-1ed3-4ccd-81d7-68809d3f6a2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba5af9c-b81f-42b1-bf96-26206c4e495c", "tag": "cfccf2b7-f03a-45d7-9992-17e3e6423c6e"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:12:10.573370 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:12:10.573370 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:12:10.611427 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-d74fb837-2157-4f8f-b3a9-32531789ef4e req-98cfddb7-1ed3-4ccd-81d7-68809d3f6a2e service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:10.614357 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-d74fb837-2157-4f8f-b3a9-32531789ef4e req-98cfddb7-1ed3-4ccd-81d7-68809d3f6a2e service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:10.642947 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-d74fb837-2157-4f8f-b3a9-32531789ef4e req-98cfddb7-1ed3-4ccd-81d7-68809d3f6a2e service nova] Creating event network-changed:cfccf2b7-f03a-45d7-9992-17e3e6423c6e for instance 7ba5af9c-b81f-42b1-bf96-26206c4e495c on hv-cinder-83008 Feb 20 20:12:10.648815 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-d74fb837-2157-4f8f-b3a9-32531789ef4e req-98cfddb7-1ed3-4ccd-81d7-68809d3f6a2e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084671 Feb 20 20:12:10.649597 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 489/972] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:12:10.669745 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c5624e00-8097-46c3-8837-687d8bd36c3a tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:10.670581 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c5624e00-8097-46c3-8837-687d8bd36c3a tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:10.680496 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c5624e00-8097-46c3-8837-687d8bd36c3a tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:10.681185 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c5624e00-8097-46c3-8837-687d8bd36c3a tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:10.682259 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c5624e00-8097-46c3-8837-687d8bd36c3a tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:10.682857 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c5624e00-8097-46c3-8837-687d8bd36c3a tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:11.008178 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c5624e00-8097-46c3-8837-687d8bd36c3a tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:11.018779 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c5624e00-8097-46c3-8837-687d8bd36c3a tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1358 microversion: 2.1 time: 0.352660 Feb 20 20:12:11.019399 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 484/973] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:10 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1358 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:12.040264 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-80ae7e00-b899-4751-b6b8-6a11cad067b8 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:12.041130 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-80ae7e00-b899-4751-b6b8-6a11cad067b8 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:12.050987 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-80ae7e00-b899-4751-b6b8-6a11cad067b8 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:12.051795 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-80ae7e00-b899-4751-b6b8-6a11cad067b8 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:12.053214 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-80ae7e00-b899-4751-b6b8-6a11cad067b8 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:12.053996 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-80ae7e00-b899-4751-b6b8-6a11cad067b8 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:12.286633 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-80ae7e00-b899-4751-b6b8-6a11cad067b8 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:12.304281 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-80ae7e00-b899-4751-b6b8-6a11cad067b8 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1358 microversion: 2.1 time: 0.269427 Feb 20 20:12:12.321162 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 490/974] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:12 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1358 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:13.334556 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-39f56ff0-9a73-4cb3-a0dd-c7cb2a36df51 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:13.334556 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-39f56ff0-9a73-4cb3-a0dd-c7cb2a36df51 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:13.342135 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-39f56ff0-9a73-4cb3-a0dd-c7cb2a36df51 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:13.342863 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-39f56ff0-9a73-4cb3-a0dd-c7cb2a36df51 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:13.343876 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-39f56ff0-9a73-4cb3-a0dd-c7cb2a36df51 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:13.344826 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-39f56ff0-9a73-4cb3-a0dd-c7cb2a36df51 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:13.578812 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-39f56ff0-9a73-4cb3-a0dd-c7cb2a36df51 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:13.588050 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-39f56ff0-9a73-4cb3-a0dd-c7cb2a36df51 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1358 microversion: 2.1 time: 0.258504 Feb 20 20:12:13.589120 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 485/975] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:13 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:14.609637 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-df215236-de08-4198-b509-73cd13bdb405 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:14.613930 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-df215236-de08-4198-b509-73cd13bdb405 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:14.637591 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-df215236-de08-4198-b509-73cd13bdb405 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:14.647039 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-df215236-de08-4198-b509-73cd13bdb405 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:14.647039 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-df215236-de08-4198-b509-73cd13bdb405 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:14.647039 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-df215236-de08-4198-b509-73cd13bdb405 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:14.889990 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-df215236-de08-4198-b509-73cd13bdb405 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:14.898887 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-df215236-de08-4198-b509-73cd13bdb405 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1358 microversion: 2.1 time: 0.296388 Feb 20 20:12:14.901301 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 491/976] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:14 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1358 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:15.097591 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-f1ad0de7-a2f4-42f4-a48d-0100a75baaef tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "603c8a6e-e7af-4d2a-b7bd-7463753c1534", "device": "/dev/sdb"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:12:15.099870 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-f1ad0de7-a2f4-42f4-a48d-0100a75baaef tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: b18afc74-8544-4a3d-8adf-1d7be316dee1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:15.108517 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f1ad0de7-a2f4-42f4-a48d-0100a75baaef tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:15.109118 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f1ad0de7-a2f4-42f4-a48d-0100a75baaef tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:15.110079 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f1ad0de7-a2f4-42f4-a48d-0100a75baaef tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:15.110888 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-f1ad0de7-a2f4-42f4-a48d-0100a75baaef tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:15.927491 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-86b18610-f8e2-485a-b38a-0f06f0407fc7 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:15.928326 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-86b18610-f8e2-485a-b38a-0f06f0407fc7 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:15.937751 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-86b18610-f8e2-485a-b38a-0f06f0407fc7 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:15.938460 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-86b18610-f8e2-485a-b38a-0f06f0407fc7 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:15.939604 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-86b18610-f8e2-485a-b38a-0f06f0407fc7 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:15.940354 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-86b18610-f8e2-485a-b38a-0f06f0407fc7 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:16.163161 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-86b18610-f8e2-485a-b38a-0f06f0407fc7 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:16.178994 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-86b18610-f8e2-485a-b38a-0f06f0407fc7 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1358 microversion: 2.1 time: 0.256621 Feb 20 20:12:16.179933 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 492/977] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:15 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1358 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:12:17.205712 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4301061f-5a48-4ad7-925d-6b977c0c7726 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:17.214338 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4301061f-5a48-4ad7-925d-6b977c0c7726 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:17.214778 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4301061f-5a48-4ad7-925d-6b977c0c7726 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:17.215666 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4301061f-5a48-4ad7-925d-6b977c0c7726 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:17.216925 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4301061f-5a48-4ad7-925d-6b977c0c7726 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:17.217709 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4301061f-5a48-4ad7-925d-6b977c0c7726 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:17.399026 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4301061f-5a48-4ad7-925d-6b977c0c7726 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:17.406775 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4301061f-5a48-4ad7-925d-6b977c0c7726 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1358 microversion: 2.1 time: 0.205387 Feb 20 20:12:17.407356 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 493/978] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:17 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:12:18.424819 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9bc48516-c65b-44da-966a-2439db09bb4d tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:18.426414 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9bc48516-c65b-44da-966a-2439db09bb4d tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:18.445843 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9bc48516-c65b-44da-966a-2439db09bb4d tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:18.446300 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9bc48516-c65b-44da-966a-2439db09bb4d tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:18.447103 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9bc48516-c65b-44da-966a-2439db09bb4d tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:18.447543 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9bc48516-c65b-44da-966a-2439db09bb4d tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:18.789073 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9bc48516-c65b-44da-966a-2439db09bb4d tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:18.799330 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9bc48516-c65b-44da-966a-2439db09bb4d tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1358 microversion: 2.1 time: 0.378201 Feb 20 20:12:18.800031 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 494/979] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:18 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1358 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:18.823744 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-f1ad0de7-a2f4-42f4-a48d-0100a75baaef tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "POST /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.735254 Feb 20 20:12:18.824840 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 486/980] 10.222.0.60 () {60 vars in 1322 bytes} [Sun Feb 20 20:12:15 2022] POST /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1/os-volume_attachments => generated 194 bytes in 3738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:12:19.818203 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-0688dd0e-0be1-43c2-bdd8-a8777add5cd3 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:19.818776 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-0688dd0e-0be1-43c2-bdd8-a8777add5cd3 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:19.825135 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0688dd0e-0be1-43c2-bdd8-a8777add5cd3 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:19.825573 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0688dd0e-0be1-43c2-bdd8-a8777add5cd3 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:19.826350 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0688dd0e-0be1-43c2-bdd8-a8777add5cd3 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:19.826785 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-0688dd0e-0be1-43c2-bdd8-a8777add5cd3 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:20.031339 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-0688dd0e-0be1-43c2-bdd8-a8777add5cd3 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:20.041526 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-0688dd0e-0be1-43c2-bdd8-a8777add5cd3 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1358 microversion: 2.1 time: 0.227600 Feb 20 20:12:20.042114 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 495/981] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:19 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:21.061684 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-363e3e58-5ac2-45ff-b70c-c13975b8f144 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:21.062505 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-363e3e58-5ac2-45ff-b70c-c13975b8f144 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:21.070530 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-363e3e58-5ac2-45ff-b70c-c13975b8f144 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:21.070971 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-363e3e58-5ac2-45ff-b70c-c13975b8f144 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:21.071831 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-363e3e58-5ac2-45ff-b70c-c13975b8f144 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:21.072264 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-363e3e58-5ac2-45ff-b70c-c13975b8f144 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:21.248028 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-363e3e58-5ac2-45ff-b70c-c13975b8f144 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:21.257000 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-363e3e58-5ac2-45ff-b70c-c13975b8f144 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1358 microversion: 2.1 time: 0.201464 Feb 20 20:12:21.262355 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 487/982] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:21 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:22.275076 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-2b2104cb-84ac-4f84-a30c-f84b0bf6a212 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:22.275683 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-2b2104cb-84ac-4f84-a30c-f84b0bf6a212 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:22.282725 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2b2104cb-84ac-4f84-a30c-f84b0bf6a212 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:22.283275 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2b2104cb-84ac-4f84-a30c-f84b0bf6a212 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:22.284185 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2b2104cb-84ac-4f84-a30c-f84b0bf6a212 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:22.285565 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-2b2104cb-84ac-4f84-a30c-f84b0bf6a212 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:22.450499 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-2b2104cb-84ac-4f84-a30c-f84b0bf6a212 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:22.458416 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-2b2104cb-84ac-4f84-a30c-f84b0bf6a212 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1358 microversion: 2.1 time: 0.186977 Feb 20 20:12:22.459092 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 496/983] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:22 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:23.476340 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-bd1e5e65-0521-4b17-9925-2ee482bb36bb tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:23.476905 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-bd1e5e65-0521-4b17-9925-2ee482bb36bb tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:23.483358 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bd1e5e65-0521-4b17-9925-2ee482bb36bb tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:23.483791 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bd1e5e65-0521-4b17-9925-2ee482bb36bb tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:23.484568 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bd1e5e65-0521-4b17-9925-2ee482bb36bb tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:23.484993 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-bd1e5e65-0521-4b17-9925-2ee482bb36bb tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:23.638207 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-bd1e5e65-0521-4b17-9925-2ee482bb36bb tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:23.646706 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-bd1e5e65-0521-4b17-9925-2ee482bb36bb tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1358 microversion: 2.1 time: 0.175114 Feb 20 20:12:23.647442 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 488/984] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:23 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:24.664943 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f7f38553-4257-4b5e-a574-a09ddffc2854 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:24.665569 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f7f38553-4257-4b5e-a574-a09ddffc2854 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:24.672179 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f7f38553-4257-4b5e-a574-a09ddffc2854 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:24.679629 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f7f38553-4257-4b5e-a574-a09ddffc2854 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:24.679629 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f7f38553-4257-4b5e-a574-a09ddffc2854 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:24.679629 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f7f38553-4257-4b5e-a574-a09ddffc2854 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:24.834407 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f7f38553-4257-4b5e-a574-a09ddffc2854 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:24.842977 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f7f38553-4257-4b5e-a574-a09ddffc2854 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1358 microversion: 2.1 time: 0.182334 Feb 20 20:12:24.843607 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 497/985] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:24 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:25.499671 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-81afb08c-d642-40aa-8a3d-4d795a8de2ca req-e3994710-8948-421f-aec7-78ee565920e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba5af9c-b81f-42b1-bf96-26206c4e495c", "name": "network-vif-plugged", "status": "completed", "tag": "cfccf2b7-f03a-45d7-9992-17e3e6423c6e"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:12:25.501399 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:12:25.501399 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:12:25.510924 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-81afb08c-d642-40aa-8a3d-4d795a8de2ca req-e3994710-8948-421f-aec7-78ee565920e5 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:25.511586 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-81afb08c-d642-40aa-8a3d-4d795a8de2ca req-e3994710-8948-421f-aec7-78ee565920e5 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:25.524670 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-81afb08c-d642-40aa-8a3d-4d795a8de2ca req-e3994710-8948-421f-aec7-78ee565920e5 service nova] Creating event network-vif-plugged:cfccf2b7-f03a-45d7-9992-17e3e6423c6e for instance 7ba5af9c-b81f-42b1-bf96-26206c4e495c on hv-cinder-83008 Feb 20 20:12:25.529881 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-81afb08c-d642-40aa-8a3d-4d795a8de2ca req-e3994710-8948-421f-aec7-78ee565920e5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034117 Feb 20 20:12:25.530516 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 489/986] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:12:25.860552 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-57e60799-eb2a-4c75-919c-a1f2d7d5fc42 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:25.861556 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-57e60799-eb2a-4c75-919c-a1f2d7d5fc42 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:25.867859 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-57e60799-eb2a-4c75-919c-a1f2d7d5fc42 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:25.868289 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-57e60799-eb2a-4c75-919c-a1f2d7d5fc42 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:25.869065 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-57e60799-eb2a-4c75-919c-a1f2d7d5fc42 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:25.869542 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-57e60799-eb2a-4c75-919c-a1f2d7d5fc42 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:26.044440 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-57e60799-eb2a-4c75-919c-a1f2d7d5fc42 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:26.058581 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-57e60799-eb2a-4c75-919c-a1f2d7d5fc42 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1358 microversion: 2.1 time: 0.201274 Feb 20 20:12:26.065578 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 498/987] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:25 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:27.077667 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c741b79b-6ab3-4980-9b7b-ee9b2c107f02 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:27.078367 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c741b79b-6ab3-4980-9b7b-ee9b2c107f02 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:27.085298 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c741b79b-6ab3-4980-9b7b-ee9b2c107f02 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:27.085743 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c741b79b-6ab3-4980-9b7b-ee9b2c107f02 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:27.086529 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c741b79b-6ab3-4980-9b7b-ee9b2c107f02 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:27.086961 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c741b79b-6ab3-4980-9b7b-ee9b2c107f02 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:27.281036 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c741b79b-6ab3-4980-9b7b-ee9b2c107f02 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:27.290125 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c741b79b-6ab3-4980-9b7b-ee9b2c107f02 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1358 microversion: 2.1 time: 0.217660 Feb 20 20:12:27.290743 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 490/988] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:27 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:28.310512 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-45bf7956-b0f2-467b-87a0-440bce477aad tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:28.311468 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-45bf7956-b0f2-467b-87a0-440bce477aad tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:28.322174 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-45bf7956-b0f2-467b-87a0-440bce477aad tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:28.322916 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-45bf7956-b0f2-467b-87a0-440bce477aad tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:28.324196 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-45bf7956-b0f2-467b-87a0-440bce477aad tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:28.324924 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-45bf7956-b0f2-467b-87a0-440bce477aad tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:28.477851 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-45bf7956-b0f2-467b-87a0-440bce477aad tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:28.493585 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-45bf7956-b0f2-467b-87a0-440bce477aad tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1549 microversion: 2.1 time: 0.189148 Feb 20 20:12:28.494688 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 499/989] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:28 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1549 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:28.525991 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-274e3275-94bf-4236-a6b2-284cd57fff7e tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:28.525991 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-274e3275-94bf-4236-a6b2-284cd57fff7e tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:28.525991 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-274e3275-94bf-4236-a6b2-284cd57fff7e tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:28.525991 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-274e3275-94bf-4236-a6b2-284cd57fff7e tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:28.527404 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-274e3275-94bf-4236-a6b2-284cd57fff7e tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:28.527404 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-274e3275-94bf-4236-a6b2-284cd57fff7e tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:28.699931 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-274e3275-94bf-4236-a6b2-284cd57fff7e tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:28.708431 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-274e3275-94bf-4236-a6b2-284cd57fff7e tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1549 microversion: 2.1 time: 0.201719 Feb 20 20:12:28.708951 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 491/990] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:28 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1549 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:12:28.724995 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bd98f8e9-145e-4051-b5a1-75d5f9e92089 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:28.728431 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:12:28.728431 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:12:28.729467 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-bd98f8e9-145e-4051-b5a1-75d5f9e92089 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:28.730209 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-bd98f8e9-145e-4051-b5a1-75d5f9e92089 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Searching by: {'deleted': False, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc'} {{(pid=117088) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 20 20:12:28.737559 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bd98f8e9-145e-4051-b5a1-75d5f9e92089 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:28.737951 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bd98f8e9-145e-4051-b5a1-75d5f9e92089 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:28.739000 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bd98f8e9-145e-4051-b5a1-75d5f9e92089 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:28.739536 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bd98f8e9-145e-4051-b5a1-75d5f9e92089 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:28.839414 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.multi_cell_list [None req-bd98f8e9-145e-4051-b5a1-75d5f9e92089 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117088) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 20 20:12:28.948370 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-bd98f8e9-145e-4051-b5a1-75d5f9e92089 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.227771 Feb 20 20:12:28.949026 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 500/991] 10.222.0.60 () {58 vars in 1124 bytes} [Sun Feb 20 20:12:28 2022] GET /compute/v2.1/servers => generated 343 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:12:28.962612 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d745e3e3-76f0-4d1c-a2df-737731f9cd36 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:28.963281 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d745e3e3-76f0-4d1c-a2df-737731f9cd36 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:28.969128 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d745e3e3-76f0-4d1c-a2df-737731f9cd36 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:28.969581 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d745e3e3-76f0-4d1c-a2df-737731f9cd36 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:28.970356 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d745e3e3-76f0-4d1c-a2df-737731f9cd36 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:28.970844 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d745e3e3-76f0-4d1c-a2df-737731f9cd36 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:29.140422 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d745e3e3-76f0-4d1c-a2df-737731f9cd36 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:29.148903 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d745e3e3-76f0-4d1c-a2df-737731f9cd36 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1549 microversion: 2.1 time: 0.190173 Feb 20 20:12:29.149518 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 492/992] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:28 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1549 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:12:33.380961 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-132c3df3-82ee-4e15-bc87-a3f9dadac602 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7dc56315-bb8d-4f48-a6d1-283dd2c83385"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:12:33.382032 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-132c3df3-82ee-4e15-bc87-a3f9dadac602 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:33.388297 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-132c3df3-82ee-4e15-bc87-a3f9dadac602 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:33.388751 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-132c3df3-82ee-4e15-bc87-a3f9dadac602 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:33.389589 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-132c3df3-82ee-4e15-bc87-a3f9dadac602 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:33.390035 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-132c3df3-82ee-4e15-bc87-a3f9dadac602 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:34.407799 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-132c3df3-82ee-4e15-bc87-a3f9dadac602 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "POST /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.030972 Feb 20 20:12:34.415571 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 501/993] 10.222.0.60 () {60 vars in 1322 bytes} [Sun Feb 20 20:12:33 2022] POST /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c/os-volume_attachments => generated 194 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:12:45.183875 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b159b0e2-416a-44fc-a5c0-7ab73b76380c tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:45.184529 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b159b0e2-416a-44fc-a5c0-7ab73b76380c tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:45.194039 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b159b0e2-416a-44fc-a5c0-7ab73b76380c tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:45.195822 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b159b0e2-416a-44fc-a5c0-7ab73b76380c tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:45.195822 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b159b0e2-416a-44fc-a5c0-7ab73b76380c tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:45.195822 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b159b0e2-416a-44fc-a5c0-7ab73b76380c tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:45.354725 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b159b0e2-416a-44fc-a5c0-7ab73b76380c tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:45.363831 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b159b0e2-416a-44fc-a5c0-7ab73b76380c tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1595 microversion: 2.1 time: 0.183709 Feb 20 20:12:45.364414 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 493/994] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:45 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1595 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:46.047969 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b4d824b0-0b1e-4509-bd1c-aae2729ad3e7 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:46.048832 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b4d824b0-0b1e-4509-bd1c-aae2729ad3e7 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: b18afc74-8544-4a3d-8adf-1d7be316dee1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:46.058207 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b4d824b0-0b1e-4509-bd1c-aae2729ad3e7 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:46.058649 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b4d824b0-0b1e-4509-bd1c-aae2729ad3e7 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:46.059451 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b4d824b0-0b1e-4509-bd1c-aae2729ad3e7 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:46.059903 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b4d824b0-0b1e-4509-bd1c-aae2729ad3e7 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:46.172247 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-b4d824b0-0b1e-4509-bd1c-aae2729ad3e7 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lazy-loading 'services' on Instance uuid b18afc74-8544-4a3d-8adf-1d7be316dee1 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:12:46.429593 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b4d824b0-0b1e-4509-bd1c-aae2729ad3e7 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1/os-volume_attachments/603c8a6e-e7af-4d2a-b7bd-7463753c1534" status: 202 len: 0 microversion: 2.1 time: 0.386122 Feb 20 20:12:46.430284 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 502/995] 10.222.0.60 () {58 vars in 1415 bytes} [Sun Feb 20 20:12:46 2022] DELETE /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1/os-volume_attachments/603c8a6e-e7af-4d2a-b7bd-7463753c1534 => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 20 20:12:46.685231 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4f65ff77-540c-4a76-9f84-bc8093c3f596 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1196755875", "imageRef": "61c0cc70-53e3-40ed-b353-ec1b5fc4eea4", "flavorRef": "452", "networks": [{"uuid": "62de0cd8-fa8d-4458-bba6-a7154aa4d7dc"}]}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:12:46.772769 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.network.neutron [None req-4f65ff77-540c-4a76-9f84-bc8093c3f596 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] validate_networks() for [('62de0cd8-fa8d-4458-bba6-a7154aa4d7dc', None, None, None, None, None)] {{(pid=117087) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 20 20:12:47.440387 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-4f65ff77-540c-4a76-9f84-bc8093c3f596 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Flavor limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 20 20:12:47.441422 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-4f65ff77-540c-4a76-9f84-bc8093c3f596 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Image limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 20 20:12:47.441422 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-4f65ff77-540c-4a76-9f84-bc8093c3f596 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Flavor pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 20 20:12:47.441962 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-4f65ff77-540c-4a76-9f84-bc8093c3f596 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Image pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 20 20:12:47.442644 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-4f65ff77-540c-4a76-9f84-bc8093c3f596 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 20 20:12:47.451490 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4f65ff77-540c-4a76-9f84-bc8093c3f596 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:47.451927 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4f65ff77-540c-4a76-9f84-bc8093c3f596 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:47.452761 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4f65ff77-540c-4a76-9f84-bc8093c3f596 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:47.453209 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4f65ff77-540c-4a76-9f84-bc8093c3f596 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:47.474225 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-4f65ff77-540c-4a76-9f84-bc8093c3f596 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Getting quotas for project e232a877693a404e8b6b783884145633. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:12:47.478778 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-4f65ff77-540c-4a76-9f84-bc8093c3f596 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Getting quotas for user abbc279b8d3a445caac45a780d15c4f5 and project e232a877693a404e8b6b783884145633. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:12:47.491743 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4f65ff77-540c-4a76-9f84-bc8093c3f596 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Going to run 1 instances... {{(pid=117087) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 20 20:12:47.494302 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4f65ff77-540c-4a76-9f84-bc8093c3f596 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61c0cc70-53e3-40ed-b353-ec1b5fc4eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 20 20:12:47.619302 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4f65ff77-540c-4a76-9f84-bc8093c3f596 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.938686 Feb 20 20:12:47.619985 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 494/996] 10.222.0.60 () {60 vars in 1146 bytes} [Sun Feb 20 20:12:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 20 20:12:47.633527 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-24a025d7-cc1a-4e13-89b7-9fd378899e82 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:47.634327 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-24a025d7-cc1a-4e13-89b7-9fd378899e82 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:47.735980 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-24a025d7-cc1a-4e13-89b7-9fd378899e82 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:47.746881 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-24a025d7-cc1a-4e13-89b7-9fd378899e82 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a" status: 200 len: 1214 microversion: 2.1 time: 0.117373 Feb 20 20:12:47.747823 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 503/997] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:47 2022] GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a => generated 1214 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:12:48.532946 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-1e865610-ddbb-42cd-829d-406b4d4bfeef req-e7518cd9-7251-4226-a8e5-f0166519af26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba5af9c-b81f-42b1-bf96-26206c4e495c", "tag": "cfccf2b7-f03a-45d7-9992-17e3e6423c6e"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:12:48.535923 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:12:48.535923 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:12:48.543956 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-1e865610-ddbb-42cd-829d-406b4d4bfeef req-e7518cd9-7251-4226-a8e5-f0166519af26 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:48.544685 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-1e865610-ddbb-42cd-829d-406b4d4bfeef req-e7518cd9-7251-4226-a8e5-f0166519af26 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:48.558214 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-1e865610-ddbb-42cd-829d-406b4d4bfeef req-e7518cd9-7251-4226-a8e5-f0166519af26 service nova] Creating event network-changed:cfccf2b7-f03a-45d7-9992-17e3e6423c6e for instance 7ba5af9c-b81f-42b1-bf96-26206c4e495c on hv-cinder-83008 Feb 20 20:12:48.563724 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-1e865610-ddbb-42cd-829d-406b4d4bfeef req-e7518cd9-7251-4226-a8e5-f0166519af26 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036524 Feb 20 20:12:48.564324 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 495/998] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:12:48.656670 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f2876e00-ffed-4f38-861a-fa81fd394e52 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:48.657338 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f2876e00-ffed-4f38-861a-fa81fd394e52 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: b18afc74-8544-4a3d-8adf-1d7be316dee1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:48.666861 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f2876e00-ffed-4f38-861a-fa81fd394e52 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:48.667660 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f2876e00-ffed-4f38-861a-fa81fd394e52 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:48.668912 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f2876e00-ffed-4f38-861a-fa81fd394e52 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:48.669836 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f2876e00-ffed-4f38-861a-fa81fd394e52 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:48.703989 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f2876e00-ffed-4f38-861a-fa81fd394e52 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: b18afc74-8544-4a3d-8adf-1d7be316dee1] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 20 20:12:48.772033 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5ceaa6f0-db0d-4b07-9c5c-8bec382e894e tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:48.773912 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5ceaa6f0-db0d-4b07-9c5c-8bec382e894e tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:48.869056 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5ceaa6f0-db0d-4b07-9c5c-8bec382e894e tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:48.890170 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5ceaa6f0-db0d-4b07-9c5c-8bec382e894e tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a" status: 200 len: 1214 microversion: 2.1 time: 0.128537 Feb 20 20:12:48.891376 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 496/999] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:48 2022] GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a => generated 1214 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:12:49.055459 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f2876e00-ffed-4f38-861a-fa81fd394e52 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1" status: 204 len: 0 microversion: 2.1 time: 0.402472 Feb 20 20:12:49.056660 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 504/1000] 10.222.0.60 () {58 vars in 1238 bytes} [Sun Feb 20 20:12:48 2022] DELETE /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 20 20:12:49.073986 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ba9116dd-b081-4651-9291-ff51f207c414 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:49.075125 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ba9116dd-b081-4651-9291-ff51f207c414 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: b18afc74-8544-4a3d-8adf-1d7be316dee1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:49.093001 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ba9116dd-b081-4651-9291-ff51f207c414 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:49.094333 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ba9116dd-b081-4651-9291-ff51f207c414 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:49.096065 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ba9116dd-b081-4651-9291-ff51f207c414 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:49.098055 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ba9116dd-b081-4651-9291-ff51f207c414 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:49.450972 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ba9116dd-b081-4651-9291-ff51f207c414 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:49.468532 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ba9116dd-b081-4651-9291-ff51f207c414 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1" status: 200 len: 1514 microversion: 2.1 time: 0.402049 Feb 20 20:12:49.475185 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 497/1001] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:49 2022] GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1 => generated 1514 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:49.911680 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-9be4664f-8568-4fe6-8b76-26af6c81fe64 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:49.912389 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-9be4664f-8568-4fe6-8b76-26af6c81fe64 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:49.918937 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9be4664f-8568-4fe6-8b76-26af6c81fe64 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:49.919381 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9be4664f-8568-4fe6-8b76-26af6c81fe64 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:49.920228 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9be4664f-8568-4fe6-8b76-26af6c81fe64 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:49.920662 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-9be4664f-8568-4fe6-8b76-26af6c81fe64 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:49.995861 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-9be4664f-8568-4fe6-8b76-26af6c81fe64 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:50.004442 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-9be4664f-8568-4fe6-8b76-26af6c81fe64 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a" status: 200 len: 1266 microversion: 2.1 time: 0.098726 Feb 20 20:12:50.005298 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 505/1002] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:49 2022] GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:50.494817 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-703a0f94-071b-4f48-8675-585d36891bac tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:50.495522 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-703a0f94-071b-4f48-8675-585d36891bac tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: b18afc74-8544-4a3d-8adf-1d7be316dee1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:50.501981 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-703a0f94-071b-4f48-8675-585d36891bac tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:50.502523 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-703a0f94-071b-4f48-8675-585d36891bac tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:50.503988 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-703a0f94-071b-4f48-8675-585d36891bac tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:50.504434 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-703a0f94-071b-4f48-8675-585d36891bac tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:50.700627 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-703a0f94-071b-4f48-8675-585d36891bac tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:50.709488 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-703a0f94-071b-4f48-8675-585d36891bac tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1" status: 200 len: 1514 microversion: 2.1 time: 0.218352 Feb 20 20:12:50.710217 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 498/1003] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:50 2022] GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1 => generated 1514 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:51.031848 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c6fc3c94-8cf8-4a6d-b258-77f9c493a74f tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:51.032486 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c6fc3c94-8cf8-4a6d-b258-77f9c493a74f tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:51.039777 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c6fc3c94-8cf8-4a6d-b258-77f9c493a74f tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:51.040236 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c6fc3c94-8cf8-4a6d-b258-77f9c493a74f tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:51.040991 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c6fc3c94-8cf8-4a6d-b258-77f9c493a74f tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:51.041455 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c6fc3c94-8cf8-4a6d-b258-77f9c493a74f tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:51.109171 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c6fc3c94-8cf8-4a6d-b258-77f9c493a74f tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:51.117524 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c6fc3c94-8cf8-4a6d-b258-77f9c493a74f tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a" status: 200 len: 1274 microversion: 2.1 time: 0.089209 Feb 20 20:12:51.123744 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 506/1004] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:51 2022] GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:51.467071 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ee400637-b2e0-413b-9770-638958f7ccda tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1585792497"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:12:51.467597 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ee400637-b2e0-413b-9770-638958f7ccda tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:51.474009 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ee400637-b2e0-413b-9770-638958f7ccda tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:51.474459 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ee400637-b2e0-413b-9770-638958f7ccda tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:51.475225 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ee400637-b2e0-413b-9770-638958f7ccda tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:51.475653 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ee400637-b2e0-413b-9770-638958f7ccda tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:51.608581 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.network.security_group_api [None req-ee400637-b2e0-413b-9770-638958f7ccda tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Adding security group c2920800-f7be-4bd5-b062-b18745f13acb to port cfccf2b7-f03a-45d7-9992-17e3e6423c6e Feb 20 20:12:51.728443 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e6d9b4d9-7be7-46cb-8ff2-cf9983063cfa tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:51.729041 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e6d9b4d9-7be7-46cb-8ff2-cf9983063cfa tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: b18afc74-8544-4a3d-8adf-1d7be316dee1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:51.734798 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e6d9b4d9-7be7-46cb-8ff2-cf9983063cfa tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:51.735245 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e6d9b4d9-7be7-46cb-8ff2-cf9983063cfa tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:51.736012 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e6d9b4d9-7be7-46cb-8ff2-cf9983063cfa tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:51.736461 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e6d9b4d9-7be7-46cb-8ff2-cf9983063cfa tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:51.964027 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e6d9b4d9-7be7-46cb-8ff2-cf9983063cfa tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:51.971520 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e6d9b4d9-7be7-46cb-8ff2-cf9983063cfa tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1" status: 200 len: 1514 microversion: 2.1 time: 0.246759 Feb 20 20:12:51.972892 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 507/1005] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:51 2022] GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1 => generated 1514 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:12:52.103966 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ee400637-b2e0-413b-9770-638958f7ccda tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "POST /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c/action" status: 202 len: 0 microversion: 2.1 time: 0.640576 Feb 20 20:12:52.104730 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 499/1006] 10.222.0.60 () {60 vars in 1277 bytes} [Sun Feb 20 20:12:51 2022] POST /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c/action => generated 0 bytes in 642 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:12:52.115803 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-36da5433-a91d-4026-af64-5da6f090467e req-edd7c608-f68b-4d5a-b036-67129f70fd27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba5af9c-b81f-42b1-bf96-26206c4e495c", "tag": "cfccf2b7-f03a-45d7-9992-17e3e6423c6e"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:12:52.117599 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:12:52.117599 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:12:52.133722 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-5fe1af13-b734-4d19-8acd-5d66b620f8b2 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:52.133722 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-5fe1af13-b734-4d19-8acd-5d66b620f8b2 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:52.134389 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-36da5433-a91d-4026-af64-5da6f090467e req-edd7c608-f68b-4d5a-b036-67129f70fd27 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:52.134389 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-36da5433-a91d-4026-af64-5da6f090467e req-edd7c608-f68b-4d5a-b036-67129f70fd27 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:52.136545 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5fe1af13-b734-4d19-8acd-5d66b620f8b2 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:52.137076 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5fe1af13-b734-4d19-8acd-5d66b620f8b2 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:52.137980 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5fe1af13-b734-4d19-8acd-5d66b620f8b2 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:52.140353 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-5fe1af13-b734-4d19-8acd-5d66b620f8b2 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:52.142505 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-36da5433-a91d-4026-af64-5da6f090467e req-edd7c608-f68b-4d5a-b036-67129f70fd27 service nova] Creating event network-changed:cfccf2b7-f03a-45d7-9992-17e3e6423c6e for instance 7ba5af9c-b81f-42b1-bf96-26206c4e495c on hv-cinder-83008 Feb 20 20:12:52.149993 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-36da5433-a91d-4026-af64-5da6f090467e req-edd7c608-f68b-4d5a-b036-67129f70fd27 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037991 Feb 20 20:12:52.150991 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 500/1007] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:12:52.157934 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3c9cdc74-8e75-45e3-a29f-c20dbe2b682b tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:52.159096 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3c9cdc74-8e75-45e3-a29f-c20dbe2b682b tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:52.168722 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3c9cdc74-8e75-45e3-a29f-c20dbe2b682b tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:52.173700 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3c9cdc74-8e75-45e3-a29f-c20dbe2b682b tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:52.173700 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3c9cdc74-8e75-45e3-a29f-c20dbe2b682b tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:52.173700 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3c9cdc74-8e75-45e3-a29f-c20dbe2b682b tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:52.251722 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3c9cdc74-8e75-45e3-a29f-c20dbe2b682b tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:52.260201 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3c9cdc74-8e75-45e3-a29f-c20dbe2b682b tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a" status: 200 len: 1274 microversion: 2.1 time: 0.107768 Feb 20 20:12:52.260880 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 501/1008] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:52 2022] GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a => generated 1274 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:52.344810 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-5fe1af13-b734-4d19-8acd-5d66b620f8b2 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:52.348917 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-5fe1af13-b734-4d19-8acd-5d66b620f8b2 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1760 microversion: 2.1 time: 0.239898 Feb 20 20:12:52.349540 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 508/1009] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:52 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1760 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:52.990954 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b05dd3c9-a08a-4a21-86fb-90e7298c4dd8 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:52.991590 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b05dd3c9-a08a-4a21-86fb-90e7298c4dd8 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: b18afc74-8544-4a3d-8adf-1d7be316dee1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:52.998086 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b05dd3c9-a08a-4a21-86fb-90e7298c4dd8 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:52.998558 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b05dd3c9-a08a-4a21-86fb-90e7298c4dd8 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:52.999570 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b05dd3c9-a08a-4a21-86fb-90e7298c4dd8 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:53.000003 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b05dd3c9-a08a-4a21-86fb-90e7298c4dd8 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:53.278546 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b7ec85d9-17d0-4d57-a516-8fa5c9bd5126 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:53.279337 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b7ec85d9-17d0-4d57-a516-8fa5c9bd5126 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:53.287720 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b7ec85d9-17d0-4d57-a516-8fa5c9bd5126 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:53.288706 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b7ec85d9-17d0-4d57-a516-8fa5c9bd5126 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:53.289899 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b7ec85d9-17d0-4d57-a516-8fa5c9bd5126 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:53.290508 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b7ec85d9-17d0-4d57-a516-8fa5c9bd5126 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:53.388839 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b7ec85d9-17d0-4d57-a516-8fa5c9bd5126 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:53.399632 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b7ec85d9-17d0-4d57-a516-8fa5c9bd5126 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a" status: 200 len: 1272 microversion: 2.1 time: 0.124882 Feb 20 20:12:53.411975 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 509/1010] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:53 2022] GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a => generated 1272 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:12:53.441887 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b05dd3c9-a08a-4a21-86fb-90e7298c4dd8 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:53.453059 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b05dd3c9-a08a-4a21-86fb-90e7298c4dd8 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1" status: 200 len: 1514 microversion: 2.1 time: 0.466721 Feb 20 20:12:53.454052 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 502/1011] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:52 2022] GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1 => generated 1514 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:54.425588 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-54cdbee1-f8e1-4021-a2ee-8d79538fb5b4 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:54.426201 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-54cdbee1-f8e1-4021-a2ee-8d79538fb5b4 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:54.452732 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-54cdbee1-f8e1-4021-a2ee-8d79538fb5b4 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:54.456758 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-54cdbee1-f8e1-4021-a2ee-8d79538fb5b4 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:54.457942 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-54cdbee1-f8e1-4021-a2ee-8d79538fb5b4 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:54.458597 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-54cdbee1-f8e1-4021-a2ee-8d79538fb5b4 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:54.470345 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-fdf3367f-0ff7-486d-93bd-0e31892e590b tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:54.472752 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-fdf3367f-0ff7-486d-93bd-0e31892e590b tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: b18afc74-8544-4a3d-8adf-1d7be316dee1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:54.488373 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fdf3367f-0ff7-486d-93bd-0e31892e590b tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:54.489664 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fdf3367f-0ff7-486d-93bd-0e31892e590b tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:54.490586 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fdf3367f-0ff7-486d-93bd-0e31892e590b tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:54.491100 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-fdf3367f-0ff7-486d-93bd-0e31892e590b tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:54.632339 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-fdf3367f-0ff7-486d-93bd-0e31892e590b tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:54.639911 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-fdf3367f-0ff7-486d-93bd-0e31892e590b tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1" status: 200 len: 1472 microversion: 2.1 time: 0.173029 Feb 20 20:12:54.640410 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 503/1012] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:54 2022] GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1 => generated 1472 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:54.646631 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-8dc95f9d-e05a-4741-9ae8-a84d8409c6f4 req-4e3c7993-93ce-4939-8768-aadf81525d9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b18afc74-8544-4a3d-8adf-1d7be316dee1", "name": "network-vif-deleted", "tag": "dba3326e-02ac-4d68-a8a5-60f820ed9d96"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:12:54.648738 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:12:54.648738 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:12:54.655916 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-8dc95f9d-e05a-4741-9ae8-a84d8409c6f4 req-4e3c7993-93ce-4939-8768-aadf81525d9a service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:54.656355 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-8dc95f9d-e05a-4741-9ae8-a84d8409c6f4 req-4e3c7993-93ce-4939-8768-aadf81525d9a service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:54.668102 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-8dc95f9d-e05a-4741-9ae8-a84d8409c6f4 req-4e3c7993-93ce-4939-8768-aadf81525d9a service nova] Creating event network-vif-deleted:dba3326e-02ac-4d68-a8a5-60f820ed9d96 for instance b18afc74-8544-4a3d-8adf-1d7be316dee1 on hv-cinder-83008 Feb 20 20:12:54.673342 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-8dc95f9d-e05a-4741-9ae8-a84d8409c6f4 req-4e3c7993-93ce-4939-8768-aadf81525d9a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031510 Feb 20 20:12:54.673952 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 504/1013] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:12:54.972547 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-54cdbee1-f8e1-4021-a2ee-8d79538fb5b4 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:54.981826 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-54cdbee1-f8e1-4021-a2ee-8d79538fb5b4 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a" status: 200 len: 1314 microversion: 2.1 time: 0.564429 Feb 20 20:12:54.983205 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 510/1014] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:54 2022] GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:55.619399 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-693d7ea1-07d4-4472-80d3-86747818b5d1 req-01a1ace5-8e7d-42ed-86c9-db8f06bb2ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41fc2d70-da66-4ff1-bf8f-915158fb034a", "tag": "dd9efcf5-ca88-4631-9322-f1a1c303bc99"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:12:55.620961 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:12:55.620961 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:12:55.628662 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-693d7ea1-07d4-4472-80d3-86747818b5d1 req-01a1ace5-8e7d-42ed-86c9-db8f06bb2ee7 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:55.629430 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-693d7ea1-07d4-4472-80d3-86747818b5d1 req-01a1ace5-8e7d-42ed-86c9-db8f06bb2ee7 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:55.641130 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-693d7ea1-07d4-4472-80d3-86747818b5d1 req-01a1ace5-8e7d-42ed-86c9-db8f06bb2ee7 service nova] Creating event network-changed:dd9efcf5-ca88-4631-9322-f1a1c303bc99 for instance 41fc2d70-da66-4ff1-bf8f-915158fb034a on hv-cinder-83008 Feb 20 20:12:55.646551 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-693d7ea1-07d4-4472-80d3-86747818b5d1 req-01a1ace5-8e7d-42ed-86c9-db8f06bb2ee7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033267 Feb 20 20:12:55.647144 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 505/1015] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:12:55.658313 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-52856ec2-7601-40ca-8dd5-c6ea12a852ab tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:55.659931 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-52856ec2-7601-40ca-8dd5-c6ea12a852ab tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: b18afc74-8544-4a3d-8adf-1d7be316dee1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:55.666052 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-52856ec2-7601-40ca-8dd5-c6ea12a852ab tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:55.666498 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-52856ec2-7601-40ca-8dd5-c6ea12a852ab tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:55.671617 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-52856ec2-7601-40ca-8dd5-c6ea12a852ab tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:55.671617 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-52856ec2-7601-40ca-8dd5-c6ea12a852ab tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:55.681648 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-52856ec2-7601-40ca-8dd5-c6ea12a852ab tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] HTTP exception thrown: Instance b18afc74-8544-4a3d-8adf-1d7be316dee1 could not be found. Feb 20 20:12:55.682227 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-52856ec2-7601-40ca-8dd5-c6ea12a852ab tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Returning 404 to user: Instance b18afc74-8544-4a3d-8adf-1d7be316dee1 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:12:55.683051 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-52856ec2-7601-40ca-8dd5-c6ea12a852ab tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1" status: 404 len: 111 microversion: 2.1 time: 0.028448 Feb 20 20:12:55.683605 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 511/1016] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:55 2022] GET /compute/v2.1/servers/b18afc74-8544-4a3d-8adf-1d7be316dee1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:12:56.000453 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9b7bc46a-4d28-4cf8-94cb-fd8a33fcab68 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:56.001184 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9b7bc46a-4d28-4cf8-94cb-fd8a33fcab68 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:56.009355 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9b7bc46a-4d28-4cf8-94cb-fd8a33fcab68 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:56.009845 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9b7bc46a-4d28-4cf8-94cb-fd8a33fcab68 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:56.010630 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9b7bc46a-4d28-4cf8-94cb-fd8a33fcab68 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:56.011065 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9b7bc46a-4d28-4cf8-94cb-fd8a33fcab68 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:56.227495 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-9b7bc46a-4d28-4cf8-94cb-fd8a33fcab68 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:56.234979 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9b7bc46a-4d28-4cf8-94cb-fd8a33fcab68 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a" status: 200 len: 1314 microversion: 2.1 time: 0.238540 Feb 20 20:12:56.235539 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 506/1017] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:55 2022] GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:57.253995 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-aae3f876-3bb2-40c5-9da9-bb9123f9be04 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:57.255325 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-aae3f876-3bb2-40c5-9da9-bb9123f9be04 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:57.262127 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aae3f876-3bb2-40c5-9da9-bb9123f9be04 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:57.262571 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aae3f876-3bb2-40c5-9da9-bb9123f9be04 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:57.263354 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aae3f876-3bb2-40c5-9da9-bb9123f9be04 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:57.263787 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-aae3f876-3bb2-40c5-9da9-bb9123f9be04 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:57.404866 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-aae3f876-3bb2-40c5-9da9-bb9123f9be04 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:57.412716 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-aae3f876-3bb2-40c5-9da9-bb9123f9be04 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a" status: 200 len: 1314 microversion: 2.1 time: 0.162447 Feb 20 20:12:57.413307 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 512/1018] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:57 2022] GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:58.430124 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-e65bac04-29dc-4341-9ef8-e80c2b8522b2 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:58.430860 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-e65bac04-29dc-4341-9ef8-e80c2b8522b2 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:58.437395 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e65bac04-29dc-4341-9ef8-e80c2b8522b2 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:58.437840 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e65bac04-29dc-4341-9ef8-e80c2b8522b2 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:58.438607 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e65bac04-29dc-4341-9ef8-e80c2b8522b2 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:58.439036 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-e65bac04-29dc-4341-9ef8-e80c2b8522b2 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:58.572973 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-e65bac04-29dc-4341-9ef8-e80c2b8522b2 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:58.580839 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-e65bac04-29dc-4341-9ef8-e80c2b8522b2 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a" status: 200 len: 1314 microversion: 2.1 time: 0.155129 Feb 20 20:12:58.581798 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 507/1019] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:58 2022] GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:12:59.598155 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7fd0c3d2-d389-43c2-bedb-a472d6b3874e tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:12:59.600002 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7fd0c3d2-d389-43c2-bedb-a472d6b3874e tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:12:59.605764 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7fd0c3d2-d389-43c2-bedb-a472d6b3874e tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:59.606145 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7fd0c3d2-d389-43c2-bedb-a472d6b3874e tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:59.606914 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7fd0c3d2-d389-43c2-bedb-a472d6b3874e tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:12:59.607343 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7fd0c3d2-d389-43c2-bedb-a472d6b3874e tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:12:59.747595 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7fd0c3d2-d389-43c2-bedb-a472d6b3874e tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:12:59.755488 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7fd0c3d2-d389-43c2-bedb-a472d6b3874e tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a" status: 200 len: 1314 microversion: 2.1 time: 0.160728 Feb 20 20:12:59.756056 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 513/1020] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:12:59 2022] GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:00.771986 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1a4e30cb-83dd-4b22-a5b0-4b504fedf3cf tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:00.772590 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1a4e30cb-83dd-4b22-a5b0-4b504fedf3cf tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:00.779897 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1a4e30cb-83dd-4b22-a5b0-4b504fedf3cf tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:00.780341 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1a4e30cb-83dd-4b22-a5b0-4b504fedf3cf tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:00.781139 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1a4e30cb-83dd-4b22-a5b0-4b504fedf3cf tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:00.781573 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1a4e30cb-83dd-4b22-a5b0-4b504fedf3cf tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:00.921814 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1a4e30cb-83dd-4b22-a5b0-4b504fedf3cf tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:00.929746 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1a4e30cb-83dd-4b22-a5b0-4b504fedf3cf tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a" status: 200 len: 1314 microversion: 2.1 time: 0.161179 Feb 20 20:13:00.930469 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 508/1021] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:00 2022] GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:01.948130 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f9e424b2-e0f1-4505-bed9-1539b0a44a8d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:01.948677 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f9e424b2-e0f1-4505-bed9-1539b0a44a8d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:01.955559 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f9e424b2-e0f1-4505-bed9-1539b0a44a8d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:01.956003 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f9e424b2-e0f1-4505-bed9-1539b0a44a8d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:01.956888 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f9e424b2-e0f1-4505-bed9-1539b0a44a8d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:01.957344 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f9e424b2-e0f1-4505-bed9-1539b0a44a8d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:02.112422 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f9e424b2-e0f1-4505-bed9-1539b0a44a8d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:02.121609 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f9e424b2-e0f1-4505-bed9-1539b0a44a8d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a" status: 200 len: 1314 microversion: 2.1 time: 0.178424 Feb 20 20:13:02.125543 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 514/1022] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:01 2022] GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:02.309749 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ba612822-4374-443f-b3f6-592ce91a6014 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1357908441", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-640523116", "security_groups": [{"name": "tempest-secgroup-smoke-1140847490"}], "block_device_mapping_v2": [{"uuid": "cc714edc-2eb0-46c2-8b4c-29887517af4f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3ddb480e-c808-4081-b0cb-679d7704b478"}]}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:13:02.422187 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.network.neutron [None req-ba612822-4374-443f-b3f6-592ce91a6014 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] validate_networks() for [('3ddb480e-c808-4081-b0cb-679d7704b478', None, None, None, None, None)] {{(pid=117087) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 20 20:13:02.842764 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-ba612822-4374-443f-b3f6-592ce91a6014 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Flavor limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 20 20:13:02.843184 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-ba612822-4374-443f-b3f6-592ce91a6014 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Image limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 20 20:13:02.843683 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-ba612822-4374-443f-b3f6-592ce91a6014 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Flavor pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 20 20:13:02.844089 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-ba612822-4374-443f-b3f6-592ce91a6014 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Image pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 20 20:13:02.844495 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-ba612822-4374-443f-b3f6-592ce91a6014 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 20 20:13:02.854098 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ba612822-4374-443f-b3f6-592ce91a6014 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:02.854536 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ba612822-4374-443f-b3f6-592ce91a6014 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:02.855357 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ba612822-4374-443f-b3f6-592ce91a6014 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:02.855768 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ba612822-4374-443f-b3f6-592ce91a6014 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:02.873824 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-ba612822-4374-443f-b3f6-592ce91a6014 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Getting quotas for project 7d15dcb9692c401e9d0e06361839bb8b. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:13:02.877860 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-ba612822-4374-443f-b3f6-592ce91a6014 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Getting quotas for user 62b3136320e64532991e5dd5a199e4d8 and project 7d15dcb9692c401e9d0e06361839bb8b. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:13:02.943787 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ba612822-4374-443f-b3f6-592ce91a6014 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Going to run 1 instances... {{(pid=117087) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 20 20:13:02.946454 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ba612822-4374-443f-b3f6-592ce91a6014 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cc714edc-2eb0-46c2-8b4c-29887517af4f',volume_size=None,volume_type=None)] {{(pid=117087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 20 20:13:03.139346 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7c7939cb-1700-4e2f-88b8-74c44a3be8d7 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:03.140070 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7c7939cb-1700-4e2f-88b8-74c44a3be8d7 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:03.146409 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7c7939cb-1700-4e2f-88b8-74c44a3be8d7 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:03.146857 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7c7939cb-1700-4e2f-88b8-74c44a3be8d7 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:03.147647 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7c7939cb-1700-4e2f-88b8-74c44a3be8d7 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:03.148756 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7c7939cb-1700-4e2f-88b8-74c44a3be8d7 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:03.305937 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7c7939cb-1700-4e2f-88b8-74c44a3be8d7 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:03.313948 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7c7939cb-1700-4e2f-88b8-74c44a3be8d7 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a" status: 200 len: 1314 microversion: 2.1 time: 0.178222 Feb 20 20:13:03.314558 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 515/1023] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:03 2022] GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:13:03.343923 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-6a5dd1b0-0593-4aad-b26c-3e80900e72da req-8d68153b-fb70-4c27-9028-d7d757596ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41fc2d70-da66-4ff1-bf8f-915158fb034a", "name": "network-vif-plugged", "status": "completed", "tag": "dd9efcf5-ca88-4631-9322-f1a1c303bc99"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:13:03.345572 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:13:03.345572 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:13:03.354999 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-6a5dd1b0-0593-4aad-b26c-3e80900e72da req-8d68153b-fb70-4c27-9028-d7d757596ce5 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:03.357241 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-6a5dd1b0-0593-4aad-b26c-3e80900e72da req-8d68153b-fb70-4c27-9028-d7d757596ce5 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:03.367052 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-6a5dd1b0-0593-4aad-b26c-3e80900e72da req-8d68153b-fb70-4c27-9028-d7d757596ce5 service nova] Creating event network-vif-plugged:dd9efcf5-ca88-4631-9322-f1a1c303bc99 for instance 41fc2d70-da66-4ff1-bf8f-915158fb034a on hv-cinder-83008 Feb 20 20:13:03.372429 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-6a5dd1b0-0593-4aad-b26c-3e80900e72da req-8d68153b-fb70-4c27-9028-d7d757596ce5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032019 Feb 20 20:13:03.373380 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 516/1024] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:13:03.507205 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ba612822-4374-443f-b3f6-592ce91a6014 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.201085 Feb 20 20:13:03.507904 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 509/1025] 10.222.0.60 () {60 vars in 1146 bytes} [Sun Feb 20 20:13:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 20 20:13:03.518258 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-49e13643-6a84-423f-b65a-12c4ed4ee08d tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:03.519096 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-49e13643-6a84-423f-b65a-12c4ed4ee08d tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:03.576004 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-49e13643-6a84-423f-b65a-12c4ed4ee08d tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:03.595717 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-49e13643-6a84-423f-b65a-12c4ed4ee08d tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1094 microversion: 2.1 time: 0.081288 Feb 20 20:13:03.596324 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 517/1026] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:03 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:04.331116 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-634e3677-e8e2-41fe-8a35-3ef733f6d509 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:04.331837 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-634e3677-e8e2-41fe-8a35-3ef733f6d509 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:04.338607 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-634e3677-e8e2-41fe-8a35-3ef733f6d509 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:04.339048 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-634e3677-e8e2-41fe-8a35-3ef733f6d509 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:04.339804 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-634e3677-e8e2-41fe-8a35-3ef733f6d509 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:04.340229 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-634e3677-e8e2-41fe-8a35-3ef733f6d509 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:04.479835 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-634e3677-e8e2-41fe-8a35-3ef733f6d509 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:04.487254 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-634e3677-e8e2-41fe-8a35-3ef733f6d509 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a" status: 200 len: 1314 microversion: 2.1 time: 0.160318 Feb 20 20:13:04.487815 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 510/1027] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:04 2022] GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:04.612694 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-def3a026-1fcc-40d7-9b63-6ae7e4fa79d6 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:04.613363 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-def3a026-1fcc-40d7-9b63-6ae7e4fa79d6 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:04.621324 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-def3a026-1fcc-40d7-9b63-6ae7e4fa79d6 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:04.621770 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-def3a026-1fcc-40d7-9b63-6ae7e4fa79d6 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:04.622553 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-def3a026-1fcc-40d7-9b63-6ae7e4fa79d6 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:04.622989 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-def3a026-1fcc-40d7-9b63-6ae7e4fa79d6 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:04.684583 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-def3a026-1fcc-40d7-9b63-6ae7e4fa79d6 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:04.692090 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-def3a026-1fcc-40d7-9b63-6ae7e4fa79d6 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1144 microversion: 2.1 time: 0.083162 Feb 20 20:13:04.692659 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 518/1028] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:04 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:05.504334 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-13cd7dc9-ef67-4650-a72b-90b1567c66ff tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:05.504875 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-13cd7dc9-ef67-4650-a72b-90b1567c66ff tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:05.511496 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-13cd7dc9-ef67-4650-a72b-90b1567c66ff tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:05.511932 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-13cd7dc9-ef67-4650-a72b-90b1567c66ff tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:05.512703 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-13cd7dc9-ef67-4650-a72b-90b1567c66ff tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:05.513159 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-13cd7dc9-ef67-4650-a72b-90b1567c66ff tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:05.664754 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-13cd7dc9-ef67-4650-a72b-90b1567c66ff tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:05.673630 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-13cd7dc9-ef67-4650-a72b-90b1567c66ff tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a" status: 200 len: 1314 microversion: 2.1 time: 0.172987 Feb 20 20:13:05.674417 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 511/1029] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:05 2022] GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:05.712953 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e0cb295a-eeaf-4b70-a0bf-2664327b3926 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:05.713755 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e0cb295a-eeaf-4b70-a0bf-2664327b3926 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:05.720721 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e0cb295a-eeaf-4b70-a0bf-2664327b3926 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:05.721203 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e0cb295a-eeaf-4b70-a0bf-2664327b3926 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:05.721995 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e0cb295a-eeaf-4b70-a0bf-2664327b3926 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:05.722693 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e0cb295a-eeaf-4b70-a0bf-2664327b3926 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:05.785390 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e0cb295a-eeaf-4b70-a0bf-2664327b3926 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:05.793647 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e0cb295a-eeaf-4b70-a0bf-2664327b3926 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1144 microversion: 2.1 time: 0.086882 Feb 20 20:13:05.794265 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 519/1030] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:05 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:06.691278 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-5f8a16bf-f479-49db-bdc6-7590a0bc3eb7 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:06.691877 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-5f8a16bf-f479-49db-bdc6-7590a0bc3eb7 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:06.698548 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5f8a16bf-f479-49db-bdc6-7590a0bc3eb7 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:06.698984 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5f8a16bf-f479-49db-bdc6-7590a0bc3eb7 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:06.699746 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5f8a16bf-f479-49db-bdc6-7590a0bc3eb7 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:06.700168 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-5f8a16bf-f479-49db-bdc6-7590a0bc3eb7 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:06.811703 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-25624a74-4ded-487e-96d5-feca53d14067 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:06.812341 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-25624a74-4ded-487e-96d5-feca53d14067 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:06.818477 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-25624a74-4ded-487e-96d5-feca53d14067 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:06.818952 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-25624a74-4ded-487e-96d5-feca53d14067 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:06.819720 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-25624a74-4ded-487e-96d5-feca53d14067 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:06.820179 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-25624a74-4ded-487e-96d5-feca53d14067 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:06.839723 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-5f8a16bf-f479-49db-bdc6-7590a0bc3eb7 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:06.847094 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-5f8a16bf-f479-49db-bdc6-7590a0bc3eb7 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a" status: 200 len: 1314 microversion: 2.1 time: 0.159440 Feb 20 20:13:06.849632 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 512/1031] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:06 2022] GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:06.886411 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-25624a74-4ded-487e-96d5-feca53d14067 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:06.894100 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-25624a74-4ded-487e-96d5-feca53d14067 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1136 microversion: 2.1 time: 0.086466 Feb 20 20:13:06.894673 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 520/1032] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:06 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1136 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:07.870466 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-153ec879-4123-4108-8fc0-7527059964bb tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:07.871069 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-153ec879-4123-4108-8fc0-7527059964bb tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:07.877392 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-153ec879-4123-4108-8fc0-7527059964bb tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:07.877833 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-153ec879-4123-4108-8fc0-7527059964bb tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:07.878599 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-153ec879-4123-4108-8fc0-7527059964bb tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:07.879022 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-153ec879-4123-4108-8fc0-7527059964bb tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:07.910696 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-440ab618-f524-43f4-a7e3-bfe93f73905a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:07.911339 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-440ab618-f524-43f4-a7e3-bfe93f73905a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:07.919338 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-440ab618-f524-43f4-a7e3-bfe93f73905a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:07.920011 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-440ab618-f524-43f4-a7e3-bfe93f73905a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:07.920989 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-440ab618-f524-43f4-a7e3-bfe93f73905a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:07.921677 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-440ab618-f524-43f4-a7e3-bfe93f73905a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:07.999377 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-440ab618-f524-43f4-a7e3-bfe93f73905a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:08.018146 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-440ab618-f524-43f4-a7e3-bfe93f73905a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1192 microversion: 2.1 time: 0.110949 Feb 20 20:13:08.018976 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 521/1033] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:07 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1192 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:13:08.049595 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-153ec879-4123-4108-8fc0-7527059964bb tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:08.058139 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-153ec879-4123-4108-8fc0-7527059964bb tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a" status: 200 len: 1499 microversion: 2.1 time: 0.191836 Feb 20 20:13:08.058727 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 513/1034] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:07 2022] GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a => generated 1499 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:08.393667 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-533c6798-4648-4548-bbab-96179d3f693e tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-935862952", "imageRef": "61c0cc70-53e3-40ed-b353-ec1b5fc4eea4", "flavorRef": "452", "networks": [{"uuid": "8f20c1af-3883-4ece-9b3a-a754941659c8"}]}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:13:08.450168 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.network.neutron [None req-533c6798-4648-4548-bbab-96179d3f693e tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] validate_networks() for [('8f20c1af-3883-4ece-9b3a-a754941659c8', None, None, None, None, None)] {{(pid=117088) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 20 20:13:08.920517 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-533c6798-4648-4548-bbab-96179d3f693e tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Flavor limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 20 20:13:08.921154 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-533c6798-4648-4548-bbab-96179d3f693e tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Image limits 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 20 20:13:08.921436 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-533c6798-4648-4548-bbab-96179d3f693e tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Flavor pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 20 20:13:08.921830 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-533c6798-4648-4548-bbab-96179d3f693e tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Image pref 0:0:0 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 20 20:13:08.922234 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.virt.hardware [None req-533c6798-4648-4548-bbab-96179d3f693e tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 20 20:13:08.932930 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-533c6798-4648-4548-bbab-96179d3f693e tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:08.932930 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-533c6798-4648-4548-bbab-96179d3f693e tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:08.933830 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-533c6798-4648-4548-bbab-96179d3f693e tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:08.934263 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-533c6798-4648-4548-bbab-96179d3f693e tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:08.950359 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-533c6798-4648-4548-bbab-96179d3f693e tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Getting quotas for project 808529e78f784dc883aa61be87436be2. Resources: {'instances', 'cores', 'ram'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:13:08.954272 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.quota [None req-533c6798-4648-4548-bbab-96179d3f693e tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Getting quotas for user 48726bef2dd64c6a89818ac908e20c7d and project 808529e78f784dc883aa61be87436be2. Resources: {'instances', 'cores', 'ram'} {{(pid=117088) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:13:08.966605 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-533c6798-4648-4548-bbab-96179d3f693e tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Going to run 1 instances... {{(pid=117088) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 20 20:13:08.969072 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-533c6798-4648-4548-bbab-96179d3f693e tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: e45f5939-6fc6-460e-add3-94d539493385] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61c0cc70-53e3-40ed-b353-ec1b5fc4eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 20 20:13:09.035168 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c5e6943b-2c73-4914-a7f0-ec95338e86d9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:09.035845 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c5e6943b-2c73-4914-a7f0-ec95338e86d9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:09.042791 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c5e6943b-2c73-4914-a7f0-ec95338e86d9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:09.043550 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c5e6943b-2c73-4914-a7f0-ec95338e86d9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:09.058422 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c5e6943b-2c73-4914-a7f0-ec95338e86d9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:09.058422 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c5e6943b-2c73-4914-a7f0-ec95338e86d9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:09.135143 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c5e6943b-2c73-4914-a7f0-ec95338e86d9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:09.142639 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c5e6943b-2c73-4914-a7f0-ec95338e86d9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1210 microversion: 2.1 time: 0.111049 Feb 20 20:13:09.143215 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 514/1035] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:09 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1210 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:13:09.245710 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-533c6798-4648-4548-bbab-96179d3f693e tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.856230 Feb 20 20:13:09.248090 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 522/1036] 10.222.0.60 () {60 vars in 1146 bytes} [Sun Feb 20 20:13:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 20 20:13:09.261303 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-bf9fca5b-daa7-4f78-bdf3-12988fa9dfdc tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:09.262134 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-bf9fca5b-daa7-4f78-bdf3-12988fa9dfdc tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: e45f5939-6fc6-460e-add3-94d539493385] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:09.311257 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-92293718-7fe9-4bc5-b48a-43d8113c2ecb tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:09.312010 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-92293718-7fe9-4bc5-b48a-43d8113c2ecb tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:09.318478 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-92293718-7fe9-4bc5-b48a-43d8113c2ecb tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:09.318967 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-92293718-7fe9-4bc5-b48a-43d8113c2ecb tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:09.319745 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-92293718-7fe9-4bc5-b48a-43d8113c2ecb tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:09.320577 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-92293718-7fe9-4bc5-b48a-43d8113c2ecb tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:09.349348 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-bf9fca5b-daa7-4f78-bdf3-12988fa9dfdc tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:09.351047 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-92293718-7fe9-4bc5-b48a-43d8113c2ecb tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 20 20:13:09.357883 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-bf9fca5b-daa7-4f78-bdf3-12988fa9dfdc tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385" status: 200 len: 1218 microversion: 2.1 time: 0.101237 Feb 20 20:13:09.359623 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 515/1037] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:09 2022] GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:09.791799 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-92293718-7fe9-4bc5-b48a-43d8113c2ecb tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "DELETE /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a" status: 204 len: 0 microversion: 2.1 time: 0.482933 Feb 20 20:13:09.796814 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 523/1038] 10.222.0.60 () {58 vars in 1238 bytes} [Sun Feb 20 20:13:09 2022] DELETE /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 20 20:13:09.802224 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d9de703d-2e37-42d8-a17a-29d3283dcfbf tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:09.802860 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d9de703d-2e37-42d8-a17a-29d3283dcfbf tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:09.810329 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d9de703d-2e37-42d8-a17a-29d3283dcfbf tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:09.810784 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d9de703d-2e37-42d8-a17a-29d3283dcfbf tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:09.811572 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d9de703d-2e37-42d8-a17a-29d3283dcfbf tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:09.812326 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d9de703d-2e37-42d8-a17a-29d3283dcfbf tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:09.990557 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d9de703d-2e37-42d8-a17a-29d3283dcfbf tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:09.999460 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d9de703d-2e37-42d8-a17a-29d3283dcfbf tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a" status: 200 len: 1505 microversion: 2.1 time: 0.201652 Feb 20 20:13:10.000041 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 516/1039] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:09 2022] GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a => generated 1505 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:10.160682 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4fa23565-aa20-4ea6-a7be-0d28611f9c9a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:10.161411 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4fa23565-aa20-4ea6-a7be-0d28611f9c9a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:10.168328 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4fa23565-aa20-4ea6-a7be-0d28611f9c9a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:10.168774 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4fa23565-aa20-4ea6-a7be-0d28611f9c9a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:10.169595 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4fa23565-aa20-4ea6-a7be-0d28611f9c9a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:10.171519 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4fa23565-aa20-4ea6-a7be-0d28611f9c9a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:10.377369 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-58957a80-d980-45c6-a523-14955191d6c5 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:10.378508 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-58957a80-d980-45c6-a523-14955191d6c5 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: e45f5939-6fc6-460e-add3-94d539493385] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:10.385121 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-58957a80-d980-45c6-a523-14955191d6c5 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:10.385581 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-58957a80-d980-45c6-a523-14955191d6c5 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:10.386351 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-58957a80-d980-45c6-a523-14955191d6c5 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:10.386784 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-58957a80-d980-45c6-a523-14955191d6c5 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:10.416041 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4fa23565-aa20-4ea6-a7be-0d28611f9c9a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:10.424725 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4fa23565-aa20-4ea6-a7be-0d28611f9c9a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1278 microversion: 2.1 time: 0.268153 Feb 20 20:13:10.425355 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 524/1040] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:10 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1278 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:10.471322 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-58957a80-d980-45c6-a523-14955191d6c5 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:10.480191 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-58957a80-d980-45c6-a523-14955191d6c5 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385" status: 200 len: 1222 microversion: 2.1 time: 0.108224 Feb 20 20:13:10.481007 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 517/1041] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:10 2022] GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385 => generated 1222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:13:10.966125 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-882668b8-2564-4d0f-9f6a-687ffb099a0a req-112a5f02-b22f-4a74-b22a-063bac066b98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "411a5340-f73c-40a1-b198-ead1269694e3", "tag": "10ac2204-83c7-4ce9-bf10-af82dd0b521e"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:13:10.969504 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:13:10.969504 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:13:10.990972 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-882668b8-2564-4d0f-9f6a-687ffb099a0a req-112a5f02-b22f-4a74-b22a-063bac066b98 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:10.990972 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-882668b8-2564-4d0f-9f6a-687ffb099a0a req-112a5f02-b22f-4a74-b22a-063bac066b98 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:11.004599 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-882668b8-2564-4d0f-9f6a-687ffb099a0a req-112a5f02-b22f-4a74-b22a-063bac066b98 service nova] Creating event network-changed:10ac2204-83c7-4ce9-bf10-af82dd0b521e for instance 411a5340-f73c-40a1-b198-ead1269694e3 on hv-cinder-83008 Feb 20 20:13:11.010329 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-882668b8-2564-4d0f-9f6a-687ffb099a0a req-112a5f02-b22f-4a74-b22a-063bac066b98 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051757 Feb 20 20:13:11.010891 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 525/1042] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:13:11.024346 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d71f430e-df74-4236-b023-0b3e9641caef tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:11.024346 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d71f430e-df74-4236-b023-0b3e9641caef tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:11.028086 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d71f430e-df74-4236-b023-0b3e9641caef tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:11.028713 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d71f430e-df74-4236-b023-0b3e9641caef tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:11.029760 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d71f430e-df74-4236-b023-0b3e9641caef tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:11.030356 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d71f430e-df74-4236-b023-0b3e9641caef tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:11.265047 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d71f430e-df74-4236-b023-0b3e9641caef tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:11.272710 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d71f430e-df74-4236-b023-0b3e9641caef tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a" status: 200 len: 1505 microversion: 2.1 time: 0.259597 Feb 20 20:13:11.273334 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 518/1043] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:11 2022] GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a => generated 1505 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:11.442757 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d3a56bf1-39ae-4e73-91e9-2273bcec2d81 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:11.443459 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d3a56bf1-39ae-4e73-91e9-2273bcec2d81 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:11.451793 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d3a56bf1-39ae-4e73-91e9-2273bcec2d81 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:11.452170 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d3a56bf1-39ae-4e73-91e9-2273bcec2d81 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:11.452957 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d3a56bf1-39ae-4e73-91e9-2273bcec2d81 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:11.453448 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d3a56bf1-39ae-4e73-91e9-2273bcec2d81 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:11.498230 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8b90ee7d-f5d9-4778-b266-38eab1685612 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:11.498921 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8b90ee7d-f5d9-4778-b266-38eab1685612 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: e45f5939-6fc6-460e-add3-94d539493385] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:11.505300 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8b90ee7d-f5d9-4778-b266-38eab1685612 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:11.505753 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8b90ee7d-f5d9-4778-b266-38eab1685612 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:11.506535 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8b90ee7d-f5d9-4778-b266-38eab1685612 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:11.507071 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8b90ee7d-f5d9-4778-b266-38eab1685612 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:11.584543 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8b90ee7d-f5d9-4778-b266-38eab1685612 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:11.592517 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8b90ee7d-f5d9-4778-b266-38eab1685612 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385" status: 200 len: 1270 microversion: 2.1 time: 0.098483 Feb 20 20:13:11.593420 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 519/1044] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:11 2022] GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385 => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:13:11.700211 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d3a56bf1-39ae-4e73-91e9-2273bcec2d81 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:11.707847 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d3a56bf1-39ae-4e73-91e9-2273bcec2d81 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1266 microversion: 2.1 time: 0.269183 Feb 20 20:13:11.708355 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 526/1045] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:11 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:12.292482 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-994c7591-1d0d-4e1c-96ba-8c9183bd649c tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:12.295662 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-994c7591-1d0d-4e1c-96ba-8c9183bd649c tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:12.302207 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-994c7591-1d0d-4e1c-96ba-8c9183bd649c tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:12.302942 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-994c7591-1d0d-4e1c-96ba-8c9183bd649c tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:12.303987 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-994c7591-1d0d-4e1c-96ba-8c9183bd649c tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:12.304583 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-994c7591-1d0d-4e1c-96ba-8c9183bd649c tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:12.500426 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-994c7591-1d0d-4e1c-96ba-8c9183bd649c tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:12.510267 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-994c7591-1d0d-4e1c-96ba-8c9183bd649c tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a" status: 200 len: 1505 microversion: 2.1 time: 0.223112 Feb 20 20:13:12.520675 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 520/1046] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:12 2022] GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a => generated 1505 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:13:12.611046 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c1d1b85e-3b4a-4d82-af3c-eda592b73883 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:12.611652 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c1d1b85e-3b4a-4d82-af3c-eda592b73883 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: e45f5939-6fc6-460e-add3-94d539493385] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:12.618008 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c1d1b85e-3b4a-4d82-af3c-eda592b73883 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:12.618452 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c1d1b85e-3b4a-4d82-af3c-eda592b73883 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:12.620259 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c1d1b85e-3b4a-4d82-af3c-eda592b73883 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:12.621036 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c1d1b85e-3b4a-4d82-af3c-eda592b73883 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:12.730299 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-aa67200e-61b2-48c0-8768-1c61a125f946 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:12.730858 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-aa67200e-61b2-48c0-8768-1c61a125f946 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:12.737788 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-aa67200e-61b2-48c0-8768-1c61a125f946 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:12.738248 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-aa67200e-61b2-48c0-8768-1c61a125f946 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:12.739243 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-aa67200e-61b2-48c0-8768-1c61a125f946 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:12.739690 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-aa67200e-61b2-48c0-8768-1c61a125f946 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:12.781033 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c1d1b85e-3b4a-4d82-af3c-eda592b73883 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:12.788587 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c1d1b85e-3b4a-4d82-af3c-eda592b73883 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385" status: 200 len: 1318 microversion: 2.1 time: 0.181327 Feb 20 20:13:12.789228 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 527/1047] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:12 2022] GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:12.890356 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-aa67200e-61b2-48c0-8768-1c61a125f946 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:12.898409 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-aa67200e-61b2-48c0-8768-1c61a125f946 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1266 microversion: 2.1 time: 0.177748 Feb 20 20:13:12.898980 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 521/1048] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:12 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:13:13.027535 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-7f7e5af1-a354-48bf-8b5d-742b2a98d618 req-2069d870-2176-4b61-b024-5d034ced10aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41fc2d70-da66-4ff1-bf8f-915158fb034a", "name": "network-vif-deleted", "tag": "dd9efcf5-ca88-4631-9322-f1a1c303bc99"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:13:13.029424 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:13:13.029424 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:13:13.036572 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-7f7e5af1-a354-48bf-8b5d-742b2a98d618 req-2069d870-2176-4b61-b024-5d034ced10aa service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:13.037116 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-7f7e5af1-a354-48bf-8b5d-742b2a98d618 req-2069d870-2176-4b61-b024-5d034ced10aa service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:13.048967 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-7f7e5af1-a354-48bf-8b5d-742b2a98d618 req-2069d870-2176-4b61-b024-5d034ced10aa service nova] Creating event network-vif-deleted:dd9efcf5-ca88-4631-9322-f1a1c303bc99 for instance 41fc2d70-da66-4ff1-bf8f-915158fb034a on hv-cinder-83008 Feb 20 20:13:13.054174 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-7f7e5af1-a354-48bf-8b5d-742b2a98d618 req-2069d870-2176-4b61-b024-5d034ced10aa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031019 Feb 20 20:13:13.054997 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 528/1049] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:13:13.528997 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8ee4fce4-8ad5-4f5b-87fe-50480e41626a tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:13.529885 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8ee4fce4-8ad5-4f5b-87fe-50480e41626a tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:13.537633 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8ee4fce4-8ad5-4f5b-87fe-50480e41626a tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:13.538415 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8ee4fce4-8ad5-4f5b-87fe-50480e41626a tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:13.539416 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8ee4fce4-8ad5-4f5b-87fe-50480e41626a tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:13.540563 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8ee4fce4-8ad5-4f5b-87fe-50480e41626a tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:13.583194 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8ee4fce4-8ad5-4f5b-87fe-50480e41626a tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:13.583769 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8ee4fce4-8ad5-4f5b-87fe-50480e41626a tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:13.585970 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-8ee4fce4-8ad5-4f5b-87fe-50480e41626a tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lazy-loading 'fault' on Instance uuid 41fc2d70-da66-4ff1-bf8f-915158fb034a {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:13:13.633748 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8ee4fce4-8ad5-4f5b-87fe-50480e41626a tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:13.642377 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8ee4fce4-8ad5-4f5b-87fe-50480e41626a tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a" status: 200 len: 1304 microversion: 2.1 time: 0.117751 Feb 20 20:13:13.643159 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 522/1050] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:13 2022] GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:13.808583 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-97b4102a-1531-41ab-b259-16996b92350a tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:13.810680 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-97b4102a-1531-41ab-b259-16996b92350a tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: e45f5939-6fc6-460e-add3-94d539493385] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:13.818536 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-97b4102a-1531-41ab-b259-16996b92350a tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:13.818984 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-97b4102a-1531-41ab-b259-16996b92350a tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:13.819778 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-97b4102a-1531-41ab-b259-16996b92350a tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:13.820215 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-97b4102a-1531-41ab-b259-16996b92350a tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:13.863125 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-2f44a170-de96-4e5e-88d3-c8cfd6fa402d req-6fb3b85a-15e4-4e60-a0ac-16b34d5f9a28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e45f5939-6fc6-460e-add3-94d539493385", "tag": "8f48541a-1b0e-4f26-9749-d9f505869dbe"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:13:13.865037 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:13:13.865037 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:13:13.873619 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-2f44a170-de96-4e5e-88d3-c8cfd6fa402d req-6fb3b85a-15e4-4e60-a0ac-16b34d5f9a28 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:13.874209 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-2f44a170-de96-4e5e-88d3-c8cfd6fa402d req-6fb3b85a-15e4-4e60-a0ac-16b34d5f9a28 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:13.894281 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-2f44a170-de96-4e5e-88d3-c8cfd6fa402d req-6fb3b85a-15e4-4e60-a0ac-16b34d5f9a28 service nova] Creating event network-changed:8f48541a-1b0e-4f26-9749-d9f505869dbe for instance e45f5939-6fc6-460e-add3-94d539493385 on hv-cinder-83008 Feb 20 20:13:13.899365 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-2f44a170-de96-4e5e-88d3-c8cfd6fa402d req-6fb3b85a-15e4-4e60-a0ac-16b34d5f9a28 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040390 Feb 20 20:13:13.899985 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 523/1051] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:13:13.916591 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-47395ee4-e527-4f92-aa1c-6b015c4099c9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:13.917325 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-47395ee4-e527-4f92-aa1c-6b015c4099c9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:13.923838 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-47395ee4-e527-4f92-aa1c-6b015c4099c9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:13.924282 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-47395ee4-e527-4f92-aa1c-6b015c4099c9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:13.925061 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-47395ee4-e527-4f92-aa1c-6b015c4099c9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:13.925531 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-47395ee4-e527-4f92-aa1c-6b015c4099c9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:13.979726 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-97b4102a-1531-41ab-b259-16996b92350a tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:13.988789 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-97b4102a-1531-41ab-b259-16996b92350a tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385" status: 200 len: 1318 microversion: 2.1 time: 0.185184 Feb 20 20:13:13.989646 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 529/1052] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:13 2022] GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:14.076733 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-47395ee4-e527-4f92-aa1c-6b015c4099c9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:14.084423 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-47395ee4-e527-4f92-aa1c-6b015c4099c9 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1266 microversion: 2.1 time: 0.172297 Feb 20 20:13:14.085021 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 524/1053] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:13 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:13:14.660781 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-fc2ee961-58f2-422e-884a-38e404b6a4ea tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:14.661430 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-fc2ee961-58f2-422e-884a-38e404b6a4ea tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: 41fc2d70-da66-4ff1-bf8f-915158fb034a] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:14.668525 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fc2ee961-58f2-422e-884a-38e404b6a4ea tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:14.668970 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fc2ee961-58f2-422e-884a-38e404b6a4ea tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:14.669787 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fc2ee961-58f2-422e-884a-38e404b6a4ea tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:14.670227 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fc2ee961-58f2-422e-884a-38e404b6a4ea tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:14.683780 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-fc2ee961-58f2-422e-884a-38e404b6a4ea tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] HTTP exception thrown: Instance 41fc2d70-da66-4ff1-bf8f-915158fb034a could not be found. Feb 20 20:13:14.684341 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-fc2ee961-58f2-422e-884a-38e404b6a4ea tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Returning 404 to user: Instance 41fc2d70-da66-4ff1-bf8f-915158fb034a could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:13:14.685212 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-fc2ee961-58f2-422e-884a-38e404b6a4ea tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a" status: 404 len: 111 microversion: 2.1 time: 0.028097 Feb 20 20:13:14.685759 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 530/1054] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:14 2022] GET /compute/v2.1/servers/41fc2d70-da66-4ff1-bf8f-915158fb034a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:13:14.742885 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-dee19bae-a04c-4299-877e-b8d9f0c71fe0 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-372929691", "imageRef": "61c0cc70-53e3-40ed-b353-ec1b5fc4eea4", "flavorRef": "452", "networks": [{"uuid": "62de0cd8-fa8d-4458-bba6-a7154aa4d7dc"}]}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:13:14.800566 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.network.neutron [None req-dee19bae-a04c-4299-877e-b8d9f0c71fe0 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] validate_networks() for [('62de0cd8-fa8d-4458-bba6-a7154aa4d7dc', None, None, None, None, None)] {{(pid=117087) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 20 20:13:15.006354 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-dac9157c-4db0-4d64-b096-5d0716e56795 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:15.007236 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-dac9157c-4db0-4d64-b096-5d0716e56795 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: e45f5939-6fc6-460e-add3-94d539493385] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:15.014778 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dac9157c-4db0-4d64-b096-5d0716e56795 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:15.015229 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dac9157c-4db0-4d64-b096-5d0716e56795 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:15.016023 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dac9157c-4db0-4d64-b096-5d0716e56795 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:15.016461 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-dac9157c-4db0-4d64-b096-5d0716e56795 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:15.253054 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-dee19bae-a04c-4299-877e-b8d9f0c71fe0 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Flavor limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 20 20:13:15.253596 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-dee19bae-a04c-4299-877e-b8d9f0c71fe0 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Image limits 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 20 20:13:15.254068 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-dee19bae-a04c-4299-877e-b8d9f0c71fe0 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Flavor pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 20 20:13:15.254470 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-dee19bae-a04c-4299-877e-b8d9f0c71fe0 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Image pref 0:0:0 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 20 20:13:15.254869 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.virt.hardware [None req-dee19bae-a04c-4299-877e-b8d9f0c71fe0 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 20 20:13:15.257147 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-dac9157c-4db0-4d64-b096-5d0716e56795 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:15.264670 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dee19bae-a04c-4299-877e-b8d9f0c71fe0 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:15.265134 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dee19bae-a04c-4299-877e-b8d9f0c71fe0 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:15.265930 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dee19bae-a04c-4299-877e-b8d9f0c71fe0 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:15.266351 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-dee19bae-a04c-4299-877e-b8d9f0c71fe0 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:15.271326 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-dac9157c-4db0-4d64-b096-5d0716e56795 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385" status: 200 len: 1318 microversion: 2.1 time: 0.268057 Feb 20 20:13:15.271507 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 531/1055] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:15 2022] GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:13:15.277172 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8f0f7c60-e144-4d23-a398-03a8f5e35e9b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:15.278477 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8f0f7c60-e144-4d23-a398-03a8f5e35e9b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:15.283762 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-dee19bae-a04c-4299-877e-b8d9f0c71fe0 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Getting quotas for project e232a877693a404e8b6b783884145633. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 20 20:13:15.286800 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8f0f7c60-e144-4d23-a398-03a8f5e35e9b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:15.287246 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8f0f7c60-e144-4d23-a398-03a8f5e35e9b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:15.288021 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.quota [None req-dee19bae-a04c-4299-877e-b8d9f0c71fe0 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Getting quotas for user abbc279b8d3a445caac45a780d15c4f5 and project e232a877693a404e8b6b783884145633. Resources: {'instances', 'cores', 'ram'} {{(pid=117087) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 20 20:13:15.288140 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8f0f7c60-e144-4d23-a398-03a8f5e35e9b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:15.288448 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8f0f7c60-e144-4d23-a398-03a8f5e35e9b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:15.302705 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-dee19bae-a04c-4299-877e-b8d9f0c71fe0 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Going to run 1 instances... {{(pid=117087) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 20 20:13:15.305198 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-dee19bae-a04c-4299-877e-b8d9f0c71fe0 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: d44d81d5-9451-4e06-a42e-ae19831e9ba1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61c0cc70-53e3-40ed-b353-ec1b5fc4eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 20 20:13:15.447171 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8f0f7c60-e144-4d23-a398-03a8f5e35e9b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:15.454601 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8f0f7c60-e144-4d23-a398-03a8f5e35e9b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1266 microversion: 2.1 time: 0.182220 Feb 20 20:13:15.455177 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 532/1056] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:15 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:15.469951 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-dee19bae-a04c-4299-877e-b8d9f0c71fe0 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731376 Feb 20 20:13:15.481533 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 525/1057] 10.222.0.60 () {60 vars in 1146 bytes} [Sun Feb 20 20:13:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 20 20:13:15.490333 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-12ef3558-c268-4de6-bd19-5b21445662d1 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:15.491245 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-12ef3558-c268-4de6-bd19-5b21445662d1 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: d44d81d5-9451-4e06-a42e-ae19831e9ba1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:15.556602 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-12ef3558-c268-4de6-bd19-5b21445662d1 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:15.564074 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-12ef3558-c268-4de6-bd19-5b21445662d1 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1" status: 200 len: 1213 microversion: 2.1 time: 0.077531 Feb 20 20:13:15.564645 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 533/1058] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:15 2022] GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:13:16.287771 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4769b7e2-3ebc-4274-91b0-98f60c86f8fb tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:16.288317 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4769b7e2-3ebc-4274-91b0-98f60c86f8fb tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: e45f5939-6fc6-460e-add3-94d539493385] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:16.295072 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4769b7e2-3ebc-4274-91b0-98f60c86f8fb tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:16.295556 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4769b7e2-3ebc-4274-91b0-98f60c86f8fb tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:16.303933 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4769b7e2-3ebc-4274-91b0-98f60c86f8fb tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:16.303933 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4769b7e2-3ebc-4274-91b0-98f60c86f8fb tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:16.439146 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4769b7e2-3ebc-4274-91b0-98f60c86f8fb tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:16.447494 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4769b7e2-3ebc-4274-91b0-98f60c86f8fb tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385" status: 200 len: 1318 microversion: 2.1 time: 0.162886 Feb 20 20:13:16.448165 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 526/1059] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:16 2022] GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:16.471653 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-626033b6-3767-4a3b-a075-41653173b626 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:16.472619 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-626033b6-3767-4a3b-a075-41653173b626 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:16.479100 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-626033b6-3767-4a3b-a075-41653173b626 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:16.482278 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-626033b6-3767-4a3b-a075-41653173b626 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:16.482278 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-626033b6-3767-4a3b-a075-41653173b626 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:16.482278 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-626033b6-3767-4a3b-a075-41653173b626 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:16.582017 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d864af80-a165-40ae-b065-e01eb6b99e99 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:16.582650 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d864af80-a165-40ae-b065-e01eb6b99e99 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: d44d81d5-9451-4e06-a42e-ae19831e9ba1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:16.589605 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d864af80-a165-40ae-b065-e01eb6b99e99 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:16.593930 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d864af80-a165-40ae-b065-e01eb6b99e99 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:16.593930 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d864af80-a165-40ae-b065-e01eb6b99e99 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:16.593930 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d864af80-a165-40ae-b065-e01eb6b99e99 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:16.631753 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-626033b6-3767-4a3b-a075-41653173b626 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:16.639317 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-626033b6-3767-4a3b-a075-41653173b626 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1266 microversion: 2.1 time: 0.171248 Feb 20 20:13:16.639963 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 534/1060] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:16 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:16.662333 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d864af80-a165-40ae-b065-e01eb6b99e99 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:16.669984 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d864af80-a165-40ae-b065-e01eb6b99e99 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1" status: 200 len: 1217 microversion: 2.1 time: 0.091552 Feb 20 20:13:16.670571 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 527/1061] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:16 2022] GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:17.465542 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-41cbf54e-ac87-4c62-b29a-bf574e1f0424 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:17.466248 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-41cbf54e-ac87-4c62-b29a-bf574e1f0424 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: e45f5939-6fc6-460e-add3-94d539493385] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:17.472761 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-41cbf54e-ac87-4c62-b29a-bf574e1f0424 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:17.473434 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-41cbf54e-ac87-4c62-b29a-bf574e1f0424 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:17.474008 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-41cbf54e-ac87-4c62-b29a-bf574e1f0424 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:17.474436 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-41cbf54e-ac87-4c62-b29a-bf574e1f0424 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:17.615219 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-41cbf54e-ac87-4c62-b29a-bf574e1f0424 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:17.622653 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-41cbf54e-ac87-4c62-b29a-bf574e1f0424 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385" status: 200 len: 1318 microversion: 2.1 time: 0.161525 Feb 20 20:13:17.623229 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 535/1062] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:17 2022] GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:17.657594 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7a0ef381-0415-44c5-b031-c5024b185502 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:17.658433 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7a0ef381-0415-44c5-b031-c5024b185502 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:17.664958 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7a0ef381-0415-44c5-b031-c5024b185502 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:17.666313 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7a0ef381-0415-44c5-b031-c5024b185502 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:17.667212 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7a0ef381-0415-44c5-b031-c5024b185502 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:17.667724 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7a0ef381-0415-44c5-b031-c5024b185502 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:17.687225 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-7ddf37de-041f-4786-8cd0-c8ce2c9a53a6 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:17.687836 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-7ddf37de-041f-4786-8cd0-c8ce2c9a53a6 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: d44d81d5-9451-4e06-a42e-ae19831e9ba1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:17.695145 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7ddf37de-041f-4786-8cd0-c8ce2c9a53a6 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:17.695605 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7ddf37de-041f-4786-8cd0-c8ce2c9a53a6 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:17.696440 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7ddf37de-041f-4786-8cd0-c8ce2c9a53a6 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:17.697183 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-7ddf37de-041f-4786-8cd0-c8ce2c9a53a6 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:17.775968 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-7ddf37de-041f-4786-8cd0-c8ce2c9a53a6 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:17.792782 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-7ddf37de-041f-4786-8cd0-c8ce2c9a53a6 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1" status: 200 len: 1273 microversion: 2.1 time: 0.109185 Feb 20 20:13:17.801418 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 536/1063] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:17 2022] GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1 => generated 1273 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:17.863559 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7a0ef381-0415-44c5-b031-c5024b185502 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:17.872196 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7a0ef381-0415-44c5-b031-c5024b185502 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1266 microversion: 2.1 time: 0.218359 Feb 20 20:13:17.872745 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 528/1064] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:17 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:18.161103 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8a30fec4-4a16-4a42-99a4-1893c266189d tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:13:18.162162 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8a30fec4-4a16-4a42-99a4-1893c266189d tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:18.169439 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8a30fec4-4a16-4a42-99a4-1893c266189d tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:18.169887 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8a30fec4-4a16-4a42-99a4-1893c266189d tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:18.170675 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8a30fec4-4a16-4a42-99a4-1893c266189d tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:18.171107 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8a30fec4-4a16-4a42-99a4-1893c266189d tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:18.401623 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8a30fec4-4a16-4a42-99a4-1893c266189d tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "POST /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c/action" status: 202 len: 0 microversion: 2.1 time: 0.244027 Feb 20 20:13:18.405136 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 537/1065] 10.222.0.60 () {60 vars in 1277 bytes} [Sun Feb 20 20:13:18 2022] POST /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:13:18.410422 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-20213979-9089-4d9c-afb0-ec9446b7778f tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:18.411834 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-20213979-9089-4d9c-afb0-ec9446b7778f tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:18.419151 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-20213979-9089-4d9c-afb0-ec9446b7778f tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:18.419473 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-20213979-9089-4d9c-afb0-ec9446b7778f tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:18.420275 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-20213979-9089-4d9c-afb0-ec9446b7778f tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:18.420717 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-20213979-9089-4d9c-afb0-ec9446b7778f tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:18.628860 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-20213979-9089-4d9c-afb0-ec9446b7778f tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:18.628860 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-20213979-9089-4d9c-afb0-ec9446b7778f tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1752 microversion: 2.1 time: 0.219477 Feb 20 20:13:18.628860 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 529/1066] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:18 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1752 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:18.641848 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a9e164f9-ae64-400a-a168-95930bce2708 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:18.642654 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a9e164f9-ae64-400a-a168-95930bce2708 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: e45f5939-6fc6-460e-add3-94d539493385] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:18.649457 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a9e164f9-ae64-400a-a168-95930bce2708 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:18.650833 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a9e164f9-ae64-400a-a168-95930bce2708 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:18.652026 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a9e164f9-ae64-400a-a168-95930bce2708 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:18.652660 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a9e164f9-ae64-400a-a168-95930bce2708 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:18.815537 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c78ec448-2634-4ce2-9166-900fa61d4d23 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:18.816795 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c78ec448-2634-4ce2-9166-900fa61d4d23 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: d44d81d5-9451-4e06-a42e-ae19831e9ba1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:18.824674 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c78ec448-2634-4ce2-9166-900fa61d4d23 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:18.825460 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c78ec448-2634-4ce2-9166-900fa61d4d23 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:18.826262 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c78ec448-2634-4ce2-9166-900fa61d4d23 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:18.826696 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c78ec448-2634-4ce2-9166-900fa61d4d23 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:18.924305 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a9e164f9-ae64-400a-a168-95930bce2708 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:18.933034 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a9e164f9-ae64-400a-a168-95930bce2708 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385" status: 200 len: 1318 microversion: 2.1 time: 0.296024 Feb 20 20:13:18.945610 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 538/1067] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:18 2022] GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:18.952841 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6750287b-ec77-412e-b4d6-d093045b9dbb tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:18.953623 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6750287b-ec77-412e-b4d6-d093045b9dbb tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:18.959513 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6750287b-ec77-412e-b4d6-d093045b9dbb tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:18.960079 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6750287b-ec77-412e-b4d6-d093045b9dbb tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:18.960961 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6750287b-ec77-412e-b4d6-d093045b9dbb tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:18.961643 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6750287b-ec77-412e-b4d6-d093045b9dbb tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:19.117179 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c78ec448-2634-4ce2-9166-900fa61d4d23 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:19.128059 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c78ec448-2634-4ce2-9166-900fa61d4d23 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1" status: 200 len: 1313 microversion: 2.1 time: 0.318228 Feb 20 20:13:19.129798 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 530/1068] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:18 2022] GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1 => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:19.263276 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6750287b-ec77-412e-b4d6-d093045b9dbb tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:19.275600 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6750287b-ec77-412e-b4d6-d093045b9dbb tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1266 microversion: 2.1 time: 0.326276 Feb 20 20:13:19.276525 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 539/1069] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:18 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1266 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:19.470376 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-cd7d9e22-008d-464c-9d01-df0d7f1680c2 req-b5470582-b7ee-4878-93e8-4f49825e10ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d44d81d5-9451-4e06-a42e-ae19831e9ba1", "tag": "36c9cad8-0994-4e5a-bd9d-ef99d72af288"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:13:19.472567 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:13:19.472567 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:13:19.481778 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-cd7d9e22-008d-464c-9d01-df0d7f1680c2 req-b5470582-b7ee-4878-93e8-4f49825e10ca service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:19.482354 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-cd7d9e22-008d-464c-9d01-df0d7f1680c2 req-b5470582-b7ee-4878-93e8-4f49825e10ca service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:19.494227 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-cd7d9e22-008d-464c-9d01-df0d7f1680c2 req-b5470582-b7ee-4878-93e8-4f49825e10ca service nova] Creating event network-changed:36c9cad8-0994-4e5a-bd9d-ef99d72af288 for instance d44d81d5-9451-4e06-a42e-ae19831e9ba1 on hv-cinder-83008 Feb 20 20:13:19.499241 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-cd7d9e22-008d-464c-9d01-df0d7f1680c2 req-b5470582-b7ee-4878-93e8-4f49825e10ca service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032618 Feb 20 20:13:19.500176 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 531/1070] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:13:19.645559 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-4640c86e-4498-4ab1-87a5-ba0241cc229f tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:19.646217 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-4640c86e-4498-4ab1-87a5-ba0241cc229f tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:19.653679 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4640c86e-4498-4ab1-87a5-ba0241cc229f tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:19.654133 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4640c86e-4498-4ab1-87a5-ba0241cc229f tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:19.654931 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4640c86e-4498-4ab1-87a5-ba0241cc229f tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:19.655373 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-4640c86e-4498-4ab1-87a5-ba0241cc229f tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:19.852789 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-4640c86e-4498-4ab1-87a5-ba0241cc229f tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:19.863929 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-4640c86e-4498-4ab1-87a5-ba0241cc229f tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1757 microversion: 2.1 time: 0.221941 Feb 20 20:13:19.873240 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 540/1071] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:19 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1757 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:19.957248 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-18668b5c-97ae-45af-b367-e911beca1ca6 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:19.961288 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-18668b5c-97ae-45af-b367-e911beca1ca6 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: e45f5939-6fc6-460e-add3-94d539493385] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:19.964356 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-18668b5c-97ae-45af-b367-e911beca1ca6 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:19.964797 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-18668b5c-97ae-45af-b367-e911beca1ca6 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:19.969511 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-18668b5c-97ae-45af-b367-e911beca1ca6 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:19.969511 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-18668b5c-97ae-45af-b367-e911beca1ca6 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:20.109500 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-18668b5c-97ae-45af-b367-e911beca1ca6 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:20.116980 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-18668b5c-97ae-45af-b367-e911beca1ca6 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385" status: 200 len: 1318 microversion: 2.1 time: 0.163832 Feb 20 20:13:20.126491 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 532/1072] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:19 2022] GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:20.146542 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-215815cf-17ff-4a00-aa95-7fdd403144ab tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:20.147352 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-215815cf-17ff-4a00-aa95-7fdd403144ab tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: d44d81d5-9451-4e06-a42e-ae19831e9ba1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:20.154282 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-215815cf-17ff-4a00-aa95-7fdd403144ab tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:20.154805 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-215815cf-17ff-4a00-aa95-7fdd403144ab tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:20.155653 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-215815cf-17ff-4a00-aa95-7fdd403144ab tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:20.156168 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-215815cf-17ff-4a00-aa95-7fdd403144ab tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:20.293191 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-10be92d5-36d2-4d86-9fba-effa63ddce0c tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:20.293803 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-10be92d5-36d2-4d86-9fba-effa63ddce0c tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:20.299200 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-215815cf-17ff-4a00-aa95-7fdd403144ab tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:20.300438 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-10be92d5-36d2-4d86-9fba-effa63ddce0c tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:20.301116 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-10be92d5-36d2-4d86-9fba-effa63ddce0c tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:20.301944 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-10be92d5-36d2-4d86-9fba-effa63ddce0c tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:20.302391 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-10be92d5-36d2-4d86-9fba-effa63ddce0c tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:20.307441 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-215815cf-17ff-4a00-aa95-7fdd403144ab tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1" status: 200 len: 1313 microversion: 2.1 time: 0.164529 Feb 20 20:13:20.311976 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 541/1073] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:20 2022] GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:20.450330 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-10be92d5-36d2-4d86-9fba-effa63ddce0c tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:20.457943 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-10be92d5-36d2-4d86-9fba-effa63ddce0c tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1266 microversion: 2.1 time: 0.169340 Feb 20 20:13:20.458519 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 533/1074] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:20 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:13:20.881306 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d045400e-802b-4ee3-b6d2-ec80092bcc30 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:20.881907 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d045400e-802b-4ee3-b6d2-ec80092bcc30 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:20.888838 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d045400e-802b-4ee3-b6d2-ec80092bcc30 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:20.889309 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d045400e-802b-4ee3-b6d2-ec80092bcc30 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:20.890070 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d045400e-802b-4ee3-b6d2-ec80092bcc30 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:20.890496 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d045400e-802b-4ee3-b6d2-ec80092bcc30 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:21.035996 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-d045400e-802b-4ee3-b6d2-ec80092bcc30 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:21.044336 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d045400e-802b-4ee3-b6d2-ec80092bcc30 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1757 microversion: 2.1 time: 0.166595 Feb 20 20:13:21.044913 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 542/1075] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:20 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:13:21.134601 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9143b658-19f5-4d7b-b011-008f1e364c38 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:21.135465 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9143b658-19f5-4d7b-b011-008f1e364c38 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: e45f5939-6fc6-460e-add3-94d539493385] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:21.141581 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9143b658-19f5-4d7b-b011-008f1e364c38 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:21.142020 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9143b658-19f5-4d7b-b011-008f1e364c38 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:21.142821 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9143b658-19f5-4d7b-b011-008f1e364c38 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:21.143249 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9143b658-19f5-4d7b-b011-008f1e364c38 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:21.283108 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-9143b658-19f5-4d7b-b011-008f1e364c38 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:21.290373 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9143b658-19f5-4d7b-b011-008f1e364c38 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385" status: 200 len: 1318 microversion: 2.1 time: 0.159889 Feb 20 20:13:21.290877 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 534/1076] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:21 2022] GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:21.327167 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-da6c181d-1683-45bc-b380-217c9ec8006d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:21.327801 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-da6c181d-1683-45bc-b380-217c9ec8006d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: d44d81d5-9451-4e06-a42e-ae19831e9ba1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:21.333816 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-da6c181d-1683-45bc-b380-217c9ec8006d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:21.334269 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-da6c181d-1683-45bc-b380-217c9ec8006d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:21.335051 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-da6c181d-1683-45bc-b380-217c9ec8006d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:21.335490 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-da6c181d-1683-45bc-b380-217c9ec8006d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:21.402997 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-d3b6dcd9-0bda-4f10-8c17-ee588ce88d80 req-8edcfb56-1317-424d-8180-d7c73346f26c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e45f5939-6fc6-460e-add3-94d539493385", "name": "network-vif-plugged", "status": "completed", "tag": "8f48541a-1b0e-4f26-9749-d9f505869dbe"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:13:21.406482 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:13:21.406482 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:13:21.420162 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-d3b6dcd9-0bda-4f10-8c17-ee588ce88d80 req-8edcfb56-1317-424d-8180-d7c73346f26c service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:21.420750 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-d3b6dcd9-0bda-4f10-8c17-ee588ce88d80 req-8edcfb56-1317-424d-8180-d7c73346f26c service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:21.443533 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-d3b6dcd9-0bda-4f10-8c17-ee588ce88d80 req-8edcfb56-1317-424d-8180-d7c73346f26c service nova] Creating event network-vif-plugged:8f48541a-1b0e-4f26-9749-d9f505869dbe for instance e45f5939-6fc6-460e-add3-94d539493385 on hv-cinder-83008 Feb 20 20:13:21.452874 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-d3b6dcd9-0bda-4f10-8c17-ee588ce88d80 req-8edcfb56-1317-424d-8180-d7c73346f26c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055294 Feb 20 20:13:21.458183 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 535/1077] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:13:21.475792 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-02f8b6f8-a412-4e3a-a796-df1ac6f39710 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:21.476953 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-02f8b6f8-a412-4e3a-a796-df1ac6f39710 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:21.484865 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-02f8b6f8-a412-4e3a-a796-df1ac6f39710 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:21.485350 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-02f8b6f8-a412-4e3a-a796-df1ac6f39710 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:21.487538 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-02f8b6f8-a412-4e3a-a796-df1ac6f39710 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:21.487538 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-02f8b6f8-a412-4e3a-a796-df1ac6f39710 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:21.487842 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-da6c181d-1683-45bc-b380-217c9ec8006d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:21.502946 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-da6c181d-1683-45bc-b380-217c9ec8006d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1" status: 200 len: 1313 microversion: 2.1 time: 0.179428 Feb 20 20:13:21.505218 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 543/1078] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:21 2022] GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:21.645948 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-02f8b6f8-a412-4e3a-a796-df1ac6f39710 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:21.654514 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-02f8b6f8-a412-4e3a-a796-df1ac6f39710 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1266 microversion: 2.1 time: 0.183113 Feb 20 20:13:21.655116 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 536/1079] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:21 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:22.062319 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-735babc1-11ee-46cc-8100-19e1b217a150 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:22.062959 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-735babc1-11ee-46cc-8100-19e1b217a150 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:22.069220 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-735babc1-11ee-46cc-8100-19e1b217a150 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:22.069669 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-735babc1-11ee-46cc-8100-19e1b217a150 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:22.070437 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-735babc1-11ee-46cc-8100-19e1b217a150 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:22.070870 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-735babc1-11ee-46cc-8100-19e1b217a150 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:22.219944 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-735babc1-11ee-46cc-8100-19e1b217a150 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:22.228596 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-735babc1-11ee-46cc-8100-19e1b217a150 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1757 microversion: 2.1 time: 0.169880 Feb 20 20:13:22.229185 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 544/1080] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:22 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:22.307701 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-61a64006-d011-4abd-abbb-7a4e5a602413 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:22.308422 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-61a64006-d011-4abd-abbb-7a4e5a602413 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: e45f5939-6fc6-460e-add3-94d539493385] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:22.314847 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-61a64006-d011-4abd-abbb-7a4e5a602413 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:22.315291 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-61a64006-d011-4abd-abbb-7a4e5a602413 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:22.316060 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-61a64006-d011-4abd-abbb-7a4e5a602413 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:22.316491 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-61a64006-d011-4abd-abbb-7a4e5a602413 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:22.453426 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-61a64006-d011-4abd-abbb-7a4e5a602413 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:22.460645 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-61a64006-d011-4abd-abbb-7a4e5a602413 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385" status: 200 len: 1318 microversion: 2.1 time: 0.157500 Feb 20 20:13:22.461291 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 537/1081] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:22 2022] GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:22.520186 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-efa1f183-9c6e-4968-810f-bfd4068992ca tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:22.520799 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-efa1f183-9c6e-4968-810f-bfd4068992ca tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: d44d81d5-9451-4e06-a42e-ae19831e9ba1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:22.527200 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-efa1f183-9c6e-4968-810f-bfd4068992ca tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:22.527814 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-efa1f183-9c6e-4968-810f-bfd4068992ca tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:22.528747 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-efa1f183-9c6e-4968-810f-bfd4068992ca tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:22.529378 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-efa1f183-9c6e-4968-810f-bfd4068992ca tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:22.669062 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-efa1f183-9c6e-4968-810f-bfd4068992ca tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:22.671151 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b12a48f8-e62e-4700-8755-dff0001b5fff tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:22.671756 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b12a48f8-e62e-4700-8755-dff0001b5fff tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:22.676473 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-efa1f183-9c6e-4968-810f-bfd4068992ca tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1" status: 200 len: 1313 microversion: 2.1 time: 0.160144 Feb 20 20:13:22.677047 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 545/1082] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:22 2022] GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:22.677570 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b12a48f8-e62e-4700-8755-dff0001b5fff tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:22.678014 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b12a48f8-e62e-4700-8755-dff0001b5fff tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:22.678786 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b12a48f8-e62e-4700-8755-dff0001b5fff tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:22.679210 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b12a48f8-e62e-4700-8755-dff0001b5fff tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:22.821232 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-b12a48f8-e62e-4700-8755-dff0001b5fff tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:22.828644 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b12a48f8-e62e-4700-8755-dff0001b5fff tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1266 microversion: 2.1 time: 0.161123 Feb 20 20:13:22.829244 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 538/1083] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:22 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:23.246812 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-3c81d2f3-be3f-41d9-b076-f81508312cc5 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:23.248055 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-3c81d2f3-be3f-41d9-b076-f81508312cc5 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:23.254359 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3c81d2f3-be3f-41d9-b076-f81508312cc5 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:23.254751 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3c81d2f3-be3f-41d9-b076-f81508312cc5 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:23.255522 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3c81d2f3-be3f-41d9-b076-f81508312cc5 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:23.255951 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-3c81d2f3-be3f-41d9-b076-f81508312cc5 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:23.416016 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-3c81d2f3-be3f-41d9-b076-f81508312cc5 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:23.424422 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-3c81d2f3-be3f-41d9-b076-f81508312cc5 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1757 microversion: 2.1 time: 0.181782 Feb 20 20:13:23.425163 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 546/1084] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:23 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:23.478642 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c1c9ce75-d177-4d9b-8b51-9a2e1de6f887 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:23.479295 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c1c9ce75-d177-4d9b-8b51-9a2e1de6f887 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: e45f5939-6fc6-460e-add3-94d539493385] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:23.485975 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c1c9ce75-d177-4d9b-8b51-9a2e1de6f887 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:23.486477 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c1c9ce75-d177-4d9b-8b51-9a2e1de6f887 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:23.487304 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c1c9ce75-d177-4d9b-8b51-9a2e1de6f887 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:23.487854 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c1c9ce75-d177-4d9b-8b51-9a2e1de6f887 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:23.565625 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-b58d168c-e3c7-484d-b4f1-f00e267c97a4 req-5ee4ce21-b3ce-4b7a-aa18-b9a6927718a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "411a5340-f73c-40a1-b198-ead1269694e3", "name": "network-vif-plugged", "status": "completed", "tag": "10ac2204-83c7-4ce9-bf10-af82dd0b521e"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:13:23.567823 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:13:23.567823 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:13:23.576626 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-b58d168c-e3c7-484d-b4f1-f00e267c97a4 req-5ee4ce21-b3ce-4b7a-aa18-b9a6927718a5 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:23.577238 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-b58d168c-e3c7-484d-b4f1-f00e267c97a4 req-5ee4ce21-b3ce-4b7a-aa18-b9a6927718a5 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:23.589287 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-b58d168c-e3c7-484d-b4f1-f00e267c97a4 req-5ee4ce21-b3ce-4b7a-aa18-b9a6927718a5 service nova] Creating event network-vif-plugged:10ac2204-83c7-4ce9-bf10-af82dd0b521e for instance 411a5340-f73c-40a1-b198-ead1269694e3 on hv-cinder-83008 Feb 20 20:13:23.594678 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-b58d168c-e3c7-484d-b4f1-f00e267c97a4 req-5ee4ce21-b3ce-4b7a-aa18-b9a6927718a5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032598 Feb 20 20:13:23.595701 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 547/1085] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:13:23.632293 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c1c9ce75-d177-4d9b-8b51-9a2e1de6f887 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:23.642254 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c1c9ce75-d177-4d9b-8b51-9a2e1de6f887 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385" status: 200 len: 1508 microversion: 2.1 time: 0.167457 Feb 20 20:13:23.642899 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 539/1086] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:23 2022] GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:23.660047 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a4fa1afe-7705-4cc0-aa6a-16c8240088f6 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc52216d-ad9d-4245-966e-c29f5db2105a", "device": "/dev/sdb"}} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:13:23.662300 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a4fa1afe-7705-4cc0-aa6a-16c8240088f6 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: e45f5939-6fc6-460e-add3-94d539493385] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:23.668226 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a4fa1afe-7705-4cc0-aa6a-16c8240088f6 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:23.668676 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a4fa1afe-7705-4cc0-aa6a-16c8240088f6 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:23.669494 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a4fa1afe-7705-4cc0-aa6a-16c8240088f6 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:23.669933 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a4fa1afe-7705-4cc0-aa6a-16c8240088f6 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:23.693791 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2645d4c7-e4be-4669-b731-53764c4dc1aa tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:23.694778 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2645d4c7-e4be-4669-b731-53764c4dc1aa tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: d44d81d5-9451-4e06-a42e-ae19831e9ba1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:23.701845 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2645d4c7-e4be-4669-b731-53764c4dc1aa tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:23.702291 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2645d4c7-e4be-4669-b731-53764c4dc1aa tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:23.703075 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2645d4c7-e4be-4669-b731-53764c4dc1aa tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:23.703547 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2645d4c7-e4be-4669-b731-53764c4dc1aa tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:23.868946 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-2645d4c7-e4be-4669-b731-53764c4dc1aa tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:23.877364 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2645d4c7-e4be-4669-b731-53764c4dc1aa tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1" status: 200 len: 1313 microversion: 2.1 time: 0.187033 Feb 20 20:13:23.877966 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 540/1087] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:23 2022] GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:13:23.882473 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-3b927bb9-fdd7-4e1b-ae50-a37bc9378a19 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:23.883270 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-3b927bb9-fdd7-4e1b-ae50-a37bc9378a19 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:23.889851 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3b927bb9-fdd7-4e1b-ae50-a37bc9378a19 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:23.890301 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3b927bb9-fdd7-4e1b-ae50-a37bc9378a19 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:23.891077 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3b927bb9-fdd7-4e1b-ae50-a37bc9378a19 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:23.891508 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-3b927bb9-fdd7-4e1b-ae50-a37bc9378a19 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:24.058140 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-3b927bb9-fdd7-4e1b-ae50-a37bc9378a19 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:24.064346 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-3b927bb9-fdd7-4e1b-ae50-a37bc9378a19 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1266 microversion: 2.1 time: 0.185310 Feb 20 20:13:24.065411 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 541/1088] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:23 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:24.442157 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c40e6c84-3029-4b18-b8f4-e9f7c7314435 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:24.442762 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c40e6c84-3029-4b18-b8f4-e9f7c7314435 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:24.449039 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c40e6c84-3029-4b18-b8f4-e9f7c7314435 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:24.449517 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c40e6c84-3029-4b18-b8f4-e9f7c7314435 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:24.450284 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c40e6c84-3029-4b18-b8f4-e9f7c7314435 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:24.450720 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c40e6c84-3029-4b18-b8f4-e9f7c7314435 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:24.543997 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a4fa1afe-7705-4cc0-aa6a-16c8240088f6 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "POST /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.887784 Feb 20 20:13:24.544622 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 548/1089] 10.222.0.60 () {60 vars in 1322 bytes} [Sun Feb 20 20:13:23 2022] POST /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385/os-volume_attachments => generated 194 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:13:24.601985 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-c40e6c84-3029-4b18-b8f4-e9f7c7314435 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:24.610147 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c40e6c84-3029-4b18-b8f4-e9f7c7314435 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1757 microversion: 2.1 time: 0.171752 Feb 20 20:13:24.610729 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 542/1090] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:24 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:13:24.894894 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8fd5bde0-45da-47a4-ae55-3a146004f840 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:24.895628 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8fd5bde0-45da-47a4-ae55-3a146004f840 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: d44d81d5-9451-4e06-a42e-ae19831e9ba1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:24.902357 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8fd5bde0-45da-47a4-ae55-3a146004f840 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:24.902803 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8fd5bde0-45da-47a4-ae55-3a146004f840 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:24.903581 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8fd5bde0-45da-47a4-ae55-3a146004f840 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:24.904016 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8fd5bde0-45da-47a4-ae55-3a146004f840 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:25.081517 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7cde7479-fdfb-456b-baed-087a01960851 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:25.082060 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7cde7479-fdfb-456b-baed-087a01960851 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:25.088380 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7cde7479-fdfb-456b-baed-087a01960851 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:25.088936 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7cde7479-fdfb-456b-baed-087a01960851 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:25.089695 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7cde7479-fdfb-456b-baed-087a01960851 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:25.090095 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7cde7479-fdfb-456b-baed-087a01960851 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:25.374348 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8fd5bde0-45da-47a4-ae55-3a146004f840 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:25.380768 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8fd5bde0-45da-47a4-ae55-3a146004f840 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1" status: 200 len: 1313 microversion: 2.1 time: 0.489853 Feb 20 20:13:25.390614 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 549/1091] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:24 2022] GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1 => generated 1313 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:25.442202 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7cde7479-fdfb-456b-baed-087a01960851 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:25.450077 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7cde7479-fdfb-456b-baed-087a01960851 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1266 microversion: 2.1 time: 0.372509 Feb 20 20:13:25.450655 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 543/1092] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:25 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1266 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:13:25.615950 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-8ac32a3d-fc7e-4c7a-b272-5048e323b088 req-7f20535c-3061-43d1-9fbd-3458b18c9f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d44d81d5-9451-4e06-a42e-ae19831e9ba1", "name": "network-vif-plugged", "status": "completed", "tag": "36c9cad8-0994-4e5a-bd9d-ef99d72af288"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:13:25.618382 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:13:25.618382 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:13:25.625769 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-8ac32a3d-fc7e-4c7a-b272-5048e323b088 req-7f20535c-3061-43d1-9fbd-3458b18c9f88 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:25.626495 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-8ac32a3d-fc7e-4c7a-b272-5048e323b088 req-7f20535c-3061-43d1-9fbd-3458b18c9f88 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:25.628598 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ccaf55a3-7b29-4f3c-b37e-f3e0f777fc64 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:25.629352 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ccaf55a3-7b29-4f3c-b37e-f3e0f777fc64 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:25.638955 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-8ac32a3d-fc7e-4c7a-b272-5048e323b088 req-7f20535c-3061-43d1-9fbd-3458b18c9f88 service nova] Creating event network-vif-plugged:36c9cad8-0994-4e5a-bd9d-ef99d72af288 for instance d44d81d5-9451-4e06-a42e-ae19831e9ba1 on hv-cinder-83008 Feb 20 20:13:25.641417 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ccaf55a3-7b29-4f3c-b37e-f3e0f777fc64 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:25.642029 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ccaf55a3-7b29-4f3c-b37e-f3e0f777fc64 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:25.646171 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ccaf55a3-7b29-4f3c-b37e-f3e0f777fc64 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:25.646171 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ccaf55a3-7b29-4f3c-b37e-f3e0f777fc64 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:25.646425 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-8ac32a3d-fc7e-4c7a-b272-5048e323b088 req-7f20535c-3061-43d1-9fbd-3458b18c9f88 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032684 Feb 20 20:13:25.646425 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 550/1093] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:13:25.810504 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ccaf55a3-7b29-4f3c-b37e-f3e0f777fc64 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:25.818776 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ccaf55a3-7b29-4f3c-b37e-f3e0f777fc64 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1757 microversion: 2.1 time: 0.194984 Feb 20 20:13:25.819345 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 544/1094] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:25 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1757 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:26.398652 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-c5195b06-2ef3-4a9c-88aa-8d6c9c0db2db tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:26.399261 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-c5195b06-2ef3-4a9c-88aa-8d6c9c0db2db tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: d44d81d5-9451-4e06-a42e-ae19831e9ba1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:26.405877 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c5195b06-2ef3-4a9c-88aa-8d6c9c0db2db tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:26.406322 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c5195b06-2ef3-4a9c-88aa-8d6c9c0db2db tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:26.407099 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c5195b06-2ef3-4a9c-88aa-8d6c9c0db2db tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:26.407526 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-c5195b06-2ef3-4a9c-88aa-8d6c9c0db2db tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:26.467752 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7c828a27-1eec-4675-86e0-519a4c302a83 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:26.468394 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7c828a27-1eec-4675-86e0-519a4c302a83 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:26.474683 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7c828a27-1eec-4675-86e0-519a4c302a83 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:26.479390 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7c828a27-1eec-4675-86e0-519a4c302a83 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:26.479390 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7c828a27-1eec-4675-86e0-519a4c302a83 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:26.479390 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7c828a27-1eec-4675-86e0-519a4c302a83 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:26.581306 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-c5195b06-2ef3-4a9c-88aa-8d6c9c0db2db tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:26.589064 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-c5195b06-2ef3-4a9c-88aa-8d6c9c0db2db tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1" status: 200 len: 1313 microversion: 2.1 time: 0.194973 Feb 20 20:13:26.593806 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 551/1095] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:26 2022] GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:26.642352 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7c828a27-1eec-4675-86e0-519a4c302a83 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:26.649952 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7c828a27-1eec-4675-86e0-519a4c302a83 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1452 microversion: 2.1 time: 0.185805 Feb 20 20:13:26.650455 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 545/1096] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:26 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1452 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:26.666345 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-6d68f06d-92cb-4fb9-a14e-44f8f0def24f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:26.667422 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-6d68f06d-92cb-4fb9-a14e-44f8f0def24f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:26.673264 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6d68f06d-92cb-4fb9-a14e-44f8f0def24f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:26.673719 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6d68f06d-92cb-4fb9-a14e-44f8f0def24f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:26.674505 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6d68f06d-92cb-4fb9-a14e-44f8f0def24f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:26.674949 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-6d68f06d-92cb-4fb9-a14e-44f8f0def24f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:26.816321 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-6d68f06d-92cb-4fb9-a14e-44f8f0def24f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:26.824254 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-6d68f06d-92cb-4fb9-a14e-44f8f0def24f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1452 microversion: 2.1 time: 0.162283 Feb 20 20:13:26.824832 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 552/1097] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:26 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:26.840883 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ffc8fef8-e59b-402f-ba89-cf84ed931c99 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:26.841524 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ffc8fef8-e59b-402f-ba89-cf84ed931c99 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:26.847791 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ffc8fef8-e59b-402f-ba89-cf84ed931c99 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:26.848236 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ffc8fef8-e59b-402f-ba89-cf84ed931c99 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:26.849013 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ffc8fef8-e59b-402f-ba89-cf84ed931c99 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:26.849590 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ffc8fef8-e59b-402f-ba89-cf84ed931c99 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:27.008269 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-ffc8fef8-e59b-402f-ba89-cf84ed931c99 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:27.016621 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ffc8fef8-e59b-402f-ba89-cf84ed931c99 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1757 microversion: 2.1 time: 0.179682 Feb 20 20:13:27.017234 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 546/1098] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:26 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:27.606298 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-053d8f9e-5420-4811-986c-84949d200ba1 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:27.606902 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-053d8f9e-5420-4811-986c-84949d200ba1 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: d44d81d5-9451-4e06-a42e-ae19831e9ba1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:27.613414 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-053d8f9e-5420-4811-986c-84949d200ba1 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:27.613859 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-053d8f9e-5420-4811-986c-84949d200ba1 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:27.614628 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-053d8f9e-5420-4811-986c-84949d200ba1 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:27.615056 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-053d8f9e-5420-4811-986c-84949d200ba1 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:27.763729 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-053d8f9e-5420-4811-986c-84949d200ba1 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:27.772601 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-053d8f9e-5420-4811-986c-84949d200ba1 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1" status: 200 len: 1497 microversion: 2.1 time: 0.170123 Feb 20 20:13:27.773365 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 553/1099] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:27 2022] GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1 => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:28.034089 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d9b34f26-a5ee-49b4-b488-47b5046d03a5 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:28.034638 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d9b34f26-a5ee-49b4-b488-47b5046d03a5 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:28.042525 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d9b34f26-a5ee-49b4-b488-47b5046d03a5 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:28.051252 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d9b34f26-a5ee-49b4-b488-47b5046d03a5 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:28.051252 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d9b34f26-a5ee-49b4-b488-47b5046d03a5 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:28.051252 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d9b34f26-a5ee-49b4-b488-47b5046d03a5 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:28.196447 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d9b34f26-a5ee-49b4-b488-47b5046d03a5 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:28.205421 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d9b34f26-a5ee-49b4-b488-47b5046d03a5 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1757 microversion: 2.1 time: 0.175176 Feb 20 20:13:28.205989 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 547/1100] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:28 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:28.796144 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-d45a4c3d-a964-415e-848b-d6cea97d28b3 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:28.796696 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d45a4c3d-a964-415e-848b-d6cea97d28b3 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: d44d81d5-9451-4e06-a42e-ae19831e9ba1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:28.803363 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d45a4c3d-a964-415e-848b-d6cea97d28b3 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:28.808726 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d45a4c3d-a964-415e-848b-d6cea97d28b3 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:28.809690 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d45a4c3d-a964-415e-848b-d6cea97d28b3 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:28.810184 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-d45a4c3d-a964-415e-848b-d6cea97d28b3 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:28.837535 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-d45a4c3d-a964-415e-848b-d6cea97d28b3 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: d44d81d5-9451-4e06-a42e-ae19831e9ba1] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 20 20:13:29.001253 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-2b05fb4f-51f8-4fd0-a48b-6204f1939261 req-e936b135-2ed9-4600-a03d-4ae7cd2f2bcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "411a5340-f73c-40a1-b198-ead1269694e3", "tag": "10ac2204-83c7-4ce9-bf10-af82dd0b521e"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:13:29.003201 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:13:29.003201 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:13:29.011244 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-2b05fb4f-51f8-4fd0-a48b-6204f1939261 req-e936b135-2ed9-4600-a03d-4ae7cd2f2bcd service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:29.012058 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-2b05fb4f-51f8-4fd0-a48b-6204f1939261 req-e936b135-2ed9-4600-a03d-4ae7cd2f2bcd service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:29.023903 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-2b05fb4f-51f8-4fd0-a48b-6204f1939261 req-e936b135-2ed9-4600-a03d-4ae7cd2f2bcd service nova] Creating event network-changed:10ac2204-83c7-4ce9-bf10-af82dd0b521e for instance 411a5340-f73c-40a1-b198-ead1269694e3 on hv-cinder-83008 Feb 20 20:13:29.029832 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-2b05fb4f-51f8-4fd0-a48b-6204f1939261 req-e936b135-2ed9-4600-a03d-4ae7cd2f2bcd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032555 Feb 20 20:13:29.030457 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 548/1101] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:13:29.168446 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-d45a4c3d-a964-415e-848b-d6cea97d28b3 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1" status: 204 len: 0 microversion: 2.1 time: 0.375825 Feb 20 20:13:29.169544 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 554/1102] 10.222.0.60 () {58 vars in 1238 bytes} [Sun Feb 20 20:13:28 2022] DELETE /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 20 20:13:29.183401 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-8215d573-5d24-4a3e-a903-af99c897f42b tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:29.186630 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-8215d573-5d24-4a3e-a903-af99c897f42b tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: d44d81d5-9451-4e06-a42e-ae19831e9ba1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:29.192893 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8215d573-5d24-4a3e-a903-af99c897f42b tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:29.193824 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8215d573-5d24-4a3e-a903-af99c897f42b tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:29.194912 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8215d573-5d24-4a3e-a903-af99c897f42b tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:29.195573 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-8215d573-5d24-4a3e-a903-af99c897f42b tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:29.224917 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-edd74002-c3ce-4b4c-b516-292c488ce157 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:29.225741 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-edd74002-c3ce-4b4c-b516-292c488ce157 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:29.233456 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-edd74002-c3ce-4b4c-b516-292c488ce157 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:29.233910 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-edd74002-c3ce-4b4c-b516-292c488ce157 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:29.235090 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-edd74002-c3ce-4b4c-b516-292c488ce157 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:29.235730 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-edd74002-c3ce-4b4c-b516-292c488ce157 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:29.459347 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-8215d573-5d24-4a3e-a903-af99c897f42b tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:29.469036 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-8215d573-5d24-4a3e-a903-af99c897f42b tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1" status: 200 len: 1503 microversion: 2.1 time: 0.294209 Feb 20 20:13:29.470018 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 549/1103] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:29 2022] GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1 => generated 1503 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:29.480104 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-edd74002-c3ce-4b4c-b516-292c488ce157 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:29.488193 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-edd74002-c3ce-4b4c-b516-292c488ce157 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1757 microversion: 2.1 time: 0.267740 Feb 20 20:13:29.489400 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 555/1104] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:29 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1757 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:30.487825 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-9187cb2b-5512-43d4-8325-30eb5f691629 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:30.488815 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-9187cb2b-5512-43d4-8325-30eb5f691629 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: d44d81d5-9451-4e06-a42e-ae19831e9ba1] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:30.495446 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9187cb2b-5512-43d4-8325-30eb5f691629 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:30.495885 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9187cb2b-5512-43d4-8325-30eb5f691629 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:30.496647 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9187cb2b-5512-43d4-8325-30eb5f691629 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:30.497073 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-9187cb2b-5512-43d4-8325-30eb5f691629 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:30.509359 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-929afd42-e1fe-45f0-a695-a0fc78afdd06 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:30.510016 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-929afd42-e1fe-45f0-a695-a0fc78afdd06 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:30.516604 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-929afd42-e1fe-45f0-a695-a0fc78afdd06 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:30.517057 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-929afd42-e1fe-45f0-a695-a0fc78afdd06 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:30.521450 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-929afd42-e1fe-45f0-a695-a0fc78afdd06 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:30.521450 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-929afd42-e1fe-45f0-a695-a0fc78afdd06 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:30.721590 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-9187cb2b-5512-43d4-8325-30eb5f691629 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:30.730927 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-9187cb2b-5512-43d4-8325-30eb5f691629 tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1" status: 200 len: 1503 microversion: 2.1 time: 0.246827 Feb 20 20:13:30.731865 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 550/1105] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:30 2022] GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1 => generated 1503 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:30.736059 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-929afd42-e1fe-45f0-a695-a0fc78afdd06 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:30.745458 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-929afd42-e1fe-45f0-a695-a0fc78afdd06 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1757 microversion: 2.1 time: 0.238974 Feb 20 20:13:30.746247 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 556/1106] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:30 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1757 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:13:31.514066 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-12d7eb16-41c7-432a-a3ca-4e2aff577d2a req-054c8356-a6eb-4b3f-a3a4-f7f38d7ec6e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d44d81d5-9451-4e06-a42e-ae19831e9ba1", "name": "network-vif-deleted", "tag": "36c9cad8-0994-4e5a-bd9d-ef99d72af288"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:13:31.515748 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:13:31.515748 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:13:31.524204 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-12d7eb16-41c7-432a-a3ca-4e2aff577d2a req-054c8356-a6eb-4b3f-a3a4-f7f38d7ec6e4 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:31.530899 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-12d7eb16-41c7-432a-a3ca-4e2aff577d2a req-054c8356-a6eb-4b3f-a3a4-f7f38d7ec6e4 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:31.537805 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-12d7eb16-41c7-432a-a3ca-4e2aff577d2a req-054c8356-a6eb-4b3f-a3a4-f7f38d7ec6e4 service nova] Creating event network-vif-deleted:36c9cad8-0994-4e5a-bd9d-ef99d72af288 for instance d44d81d5-9451-4e06-a42e-ae19831e9ba1 on hv-cinder-83008 Feb 20 20:13:31.543353 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-12d7eb16-41c7-432a-a3ca-4e2aff577d2a req-054c8356-a6eb-4b3f-a3a4-f7f38d7ec6e4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033400 Feb 20 20:13:31.543961 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 551/1107] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:13:31.748536 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-bdad5a16-e447-4a08-b3d1-9d3046b5b9bd tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:31.749070 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-bdad5a16-e447-4a08-b3d1-9d3046b5b9bd tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: d44d81d5-9451-4e06-a42e-ae19831e9ba1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:31.755428 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bdad5a16-e447-4a08-b3d1-9d3046b5b9bd tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:31.755903 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bdad5a16-e447-4a08-b3d1-9d3046b5b9bd tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:31.756778 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bdad5a16-e447-4a08-b3d1-9d3046b5b9bd tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:31.757198 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-bdad5a16-e447-4a08-b3d1-9d3046b5b9bd tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:31.764277 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7ca6a5a6-f596-48da-8a5d-516c071e9711 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:31.764971 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7ca6a5a6-f596-48da-8a5d-516c071e9711 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:31.771292 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7ca6a5a6-f596-48da-8a5d-516c071e9711 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:31.771740 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7ca6a5a6-f596-48da-8a5d-516c071e9711 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:31.772517 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7ca6a5a6-f596-48da-8a5d-516c071e9711 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:31.772953 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7ca6a5a6-f596-48da-8a5d-516c071e9711 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:31.821578 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-bdad5a16-e447-4a08-b3d1-9d3046b5b9bd tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbc279b8d3a445caac45a780d15c4f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e232a877693a404e8b6b783884145633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:31.833190 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-bdad5a16-e447-4a08-b3d1-9d3046b5b9bd tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1" status: 200 len: 1298 microversion: 2.1 time: 0.088939 Feb 20 20:13:31.834222 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 557/1108] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:31 2022] GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1 => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:13:31.944394 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7ca6a5a6-f596-48da-8a5d-516c071e9711 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:31.959301 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7ca6a5a6-f596-48da-8a5d-516c071e9711 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1757 microversion: 2.1 time: 0.199822 Feb 20 20:13:31.959916 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 552/1109] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:31 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1757 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:13:32.850667 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b99638b6-48eb-4101-9cb8-33185664542d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:32.851310 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b99638b6-48eb-4101-9cb8-33185664542d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] [instance: d44d81d5-9451-4e06-a42e-ae19831e9ba1] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:32.858380 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b99638b6-48eb-4101-9cb8-33185664542d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:32.858919 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b99638b6-48eb-4101-9cb8-33185664542d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:32.859700 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b99638b6-48eb-4101-9cb8-33185664542d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:32.860129 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b99638b6-48eb-4101-9cb8-33185664542d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:32.874096 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-b99638b6-48eb-4101-9cb8-33185664542d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] HTTP exception thrown: Instance d44d81d5-9451-4e06-a42e-ae19831e9ba1 could not be found. Feb 20 20:13:32.874683 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b99638b6-48eb-4101-9cb8-33185664542d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] Returning 404 to user: Instance d44d81d5-9451-4e06-a42e-ae19831e9ba1 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:13:32.875503 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b99638b6-48eb-4101-9cb8-33185664542d tempest-VolumesActionsTest-317479023 tempest-VolumesActionsTest-317479023-project] 10.222.0.60 "GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1" status: 404 len: 111 microversion: 2.1 time: 0.029087 Feb 20 20:13:32.876066 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 558/1110] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:32 2022] GET /compute/v2.1/servers/d44d81d5-9451-4e06-a42e-ae19831e9ba1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:13:32.977566 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6ea710bc-634d-436e-9b19-4cf90df871a7 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:32.978169 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6ea710bc-634d-436e-9b19-4cf90df871a7 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:32.984539 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6ea710bc-634d-436e-9b19-4cf90df871a7 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:32.984983 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6ea710bc-634d-436e-9b19-4cf90df871a7 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:32.985782 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6ea710bc-634d-436e-9b19-4cf90df871a7 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:32.986221 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6ea710bc-634d-436e-9b19-4cf90df871a7 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:33.156320 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-6ea710bc-634d-436e-9b19-4cf90df871a7 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:33.164395 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6ea710bc-634d-436e-9b19-4cf90df871a7 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1757 microversion: 2.1 time: 0.190537 Feb 20 20:13:33.164972 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 553/1111] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:32 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:34.182192 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-beeb15b6-068c-4b05-ba9c-d8b36851fddd tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:34.183484 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-beeb15b6-068c-4b05-ba9c-d8b36851fddd tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:34.189617 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-beeb15b6-068c-4b05-ba9c-d8b36851fddd tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:34.190070 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-beeb15b6-068c-4b05-ba9c-d8b36851fddd tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:34.190887 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-beeb15b6-068c-4b05-ba9c-d8b36851fddd tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:34.191318 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-beeb15b6-068c-4b05-ba9c-d8b36851fddd tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:34.346396 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-beeb15b6-068c-4b05-ba9c-d8b36851fddd tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:34.354590 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-beeb15b6-068c-4b05-ba9c-d8b36851fddd tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1757 microversion: 2.1 time: 0.176180 Feb 20 20:13:34.355093 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 559/1112] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:34 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:35.371770 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1bf6d375-786d-4ff0-864a-6d50d8f7ba35 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:35.372383 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1bf6d375-786d-4ff0-864a-6d50d8f7ba35 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:35.379046 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1bf6d375-786d-4ff0-864a-6d50d8f7ba35 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:35.379495 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1bf6d375-786d-4ff0-864a-6d50d8f7ba35 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:35.380271 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1bf6d375-786d-4ff0-864a-6d50d8f7ba35 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:35.380700 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1bf6d375-786d-4ff0-864a-6d50d8f7ba35 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:35.539168 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1bf6d375-786d-4ff0-864a-6d50d8f7ba35 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:35.549351 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1bf6d375-786d-4ff0-864a-6d50d8f7ba35 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1757 microversion: 2.1 time: 0.181301 Feb 20 20:13:35.550003 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 554/1113] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:35 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:36.566736 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f85138c7-69cf-419c-8fcf-ccb6ce6bede9 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:36.567378 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f85138c7-69cf-419c-8fcf-ccb6ce6bede9 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:36.573892 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f85138c7-69cf-419c-8fcf-ccb6ce6bede9 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:36.574159 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f85138c7-69cf-419c-8fcf-ccb6ce6bede9 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:36.574937 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f85138c7-69cf-419c-8fcf-ccb6ce6bede9 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:36.575478 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f85138c7-69cf-419c-8fcf-ccb6ce6bede9 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:36.730033 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f85138c7-69cf-419c-8fcf-ccb6ce6bede9 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:36.742522 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f85138c7-69cf-419c-8fcf-ccb6ce6bede9 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1757 microversion: 2.1 time: 0.179352 Feb 20 20:13:36.743112 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 560/1114] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:36 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:37.759577 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-11497118-050a-4000-8b27-1d4ee7ff3677 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:37.760181 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-11497118-050a-4000-8b27-1d4ee7ff3677 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:37.766574 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-11497118-050a-4000-8b27-1d4ee7ff3677 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:37.767016 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-11497118-050a-4000-8b27-1d4ee7ff3677 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:37.767783 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-11497118-050a-4000-8b27-1d4ee7ff3677 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:37.768218 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-11497118-050a-4000-8b27-1d4ee7ff3677 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:37.927258 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-11497118-050a-4000-8b27-1d4ee7ff3677 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:37.935359 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-11497118-050a-4000-8b27-1d4ee7ff3677 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1757 microversion: 2.1 time: 0.179471 Feb 20 20:13:37.937207 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 555/1115] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:37 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:38.953603 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f41cc1dc-3325-4a0e-85d7-888869d28e66 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:38.954217 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f41cc1dc-3325-4a0e-85d7-888869d28e66 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:38.960739 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f41cc1dc-3325-4a0e-85d7-888869d28e66 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:38.961219 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f41cc1dc-3325-4a0e-85d7-888869d28e66 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:38.962098 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f41cc1dc-3325-4a0e-85d7-888869d28e66 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:38.962530 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f41cc1dc-3325-4a0e-85d7-888869d28e66 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:39.113316 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f41cc1dc-3325-4a0e-85d7-888869d28e66 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:39.121771 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f41cc1dc-3325-4a0e-85d7-888869d28e66 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1757 microversion: 2.1 time: 0.172433 Feb 20 20:13:39.122350 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 561/1116] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:38 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:40.140756 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-222f1673-3ff1-4f01-9ec5-936a0488a1d3 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:40.141434 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-222f1673-3ff1-4f01-9ec5-936a0488a1d3 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:40.147922 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-222f1673-3ff1-4f01-9ec5-936a0488a1d3 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:40.148369 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-222f1673-3ff1-4f01-9ec5-936a0488a1d3 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:40.149185 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-222f1673-3ff1-4f01-9ec5-936a0488a1d3 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:40.149624 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-222f1673-3ff1-4f01-9ec5-936a0488a1d3 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:40.297452 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-222f1673-3ff1-4f01-9ec5-936a0488a1d3 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:40.305654 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-222f1673-3ff1-4f01-9ec5-936a0488a1d3 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1757 microversion: 2.1 time: 0.169976 Feb 20 20:13:40.306246 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 556/1117] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:40 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:41.323681 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-fd0508c5-9340-4e6c-8bb9-4da1ccd9e77c tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:41.324214 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-fd0508c5-9340-4e6c-8bb9-4da1ccd9e77c tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:41.331709 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fd0508c5-9340-4e6c-8bb9-4da1ccd9e77c tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:41.332156 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fd0508c5-9340-4e6c-8bb9-4da1ccd9e77c tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:41.332933 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fd0508c5-9340-4e6c-8bb9-4da1ccd9e77c tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:41.333432 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-fd0508c5-9340-4e6c-8bb9-4da1ccd9e77c tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:41.491019 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-fd0508c5-9340-4e6c-8bb9-4da1ccd9e77c tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:41.499742 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-fd0508c5-9340-4e6c-8bb9-4da1ccd9e77c tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1757 microversion: 2.1 time: 0.179981 Feb 20 20:13:41.500311 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 562/1118] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:41 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:13:42.516739 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-7cd1b765-e2ed-4e81-832e-fdd1acd21986 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:42.517394 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-7cd1b765-e2ed-4e81-832e-fdd1acd21986 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:42.523774 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7cd1b765-e2ed-4e81-832e-fdd1acd21986 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:42.524221 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7cd1b765-e2ed-4e81-832e-fdd1acd21986 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:42.525005 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7cd1b765-e2ed-4e81-832e-fdd1acd21986 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:42.525495 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-7cd1b765-e2ed-4e81-832e-fdd1acd21986 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:42.677631 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-7cd1b765-e2ed-4e81-832e-fdd1acd21986 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:42.686498 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-7cd1b765-e2ed-4e81-832e-fdd1acd21986 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1757 microversion: 2.1 time: 0.172776 Feb 20 20:13:42.687077 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 557/1119] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:42 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:43.704572 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-857be10f-4c2b-4da2-a445-12f03584f64b tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:43.705237 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-857be10f-4c2b-4da2-a445-12f03584f64b tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:43.712839 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-857be10f-4c2b-4da2-a445-12f03584f64b tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:43.713397 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-857be10f-4c2b-4da2-a445-12f03584f64b tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:43.714177 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-857be10f-4c2b-4da2-a445-12f03584f64b tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:43.714641 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-857be10f-4c2b-4da2-a445-12f03584f64b tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:43.872058 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-857be10f-4c2b-4da2-a445-12f03584f64b tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:43.880659 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-857be10f-4c2b-4da2-a445-12f03584f64b tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1757 microversion: 2.1 time: 0.180415 Feb 20 20:13:43.881450 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 563/1120] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:43 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:44.900495 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-542a5c0f-bf36-4bf0-ae16-9d449b0a6e0b tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:44.901516 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-542a5c0f-bf36-4bf0-ae16-9d449b0a6e0b tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:44.908992 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-542a5c0f-bf36-4bf0-ae16-9d449b0a6e0b tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:44.909830 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-542a5c0f-bf36-4bf0-ae16-9d449b0a6e0b tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:44.910959 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-542a5c0f-bf36-4bf0-ae16-9d449b0a6e0b tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:44.912175 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-542a5c0f-bf36-4bf0-ae16-9d449b0a6e0b tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:45.103538 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-542a5c0f-bf36-4bf0-ae16-9d449b0a6e0b tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:45.115431 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-542a5c0f-bf36-4bf0-ae16-9d449b0a6e0b tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1760 microversion: 2.1 time: 0.220692 Feb 20 20:13:45.116699 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 558/1121] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:44 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1760 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:47.915587 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-40ff8ff0-83e4-41c4-8d4e-f491f6325280 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:47.916346 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-40ff8ff0-83e4-41c4-8d4e-f491f6325280 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: e45f5939-6fc6-460e-add3-94d539493385] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:47.924740 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-40ff8ff0-83e4-41c4-8d4e-f491f6325280 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:47.925363 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-40ff8ff0-83e4-41c4-8d4e-f491f6325280 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:47.926404 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-40ff8ff0-83e4-41c4-8d4e-f491f6325280 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:47.927494 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-40ff8ff0-83e4-41c4-8d4e-f491f6325280 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:48.196830 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-40ff8ff0-83e4-41c4-8d4e-f491f6325280 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lazy-loading 'services' on Instance uuid e45f5939-6fc6-460e-add3-94d539493385 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:13:48.427870 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-40ff8ff0-83e4-41c4-8d4e-f491f6325280 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385/os-volume_attachments/cc52216d-ad9d-4245-966e-c29f5db2105a" status: 202 len: 0 microversion: 2.1 time: 0.516667 Feb 20 20:13:48.433870 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 564/1122] 10.222.0.60 () {58 vars in 1415 bytes} [Sun Feb 20 20:13:47 2022] DELETE /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385/os-volume_attachments/cc52216d-ad9d-4245-966e-c29f5db2105a => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:13:50.710221 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-0b337fbe-fe56-4f3e-a0db-ecd2e67c91af tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:50.710898 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-0b337fbe-fe56-4f3e-a0db-ecd2e67c91af tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: e45f5939-6fc6-460e-add3-94d539493385] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:50.718443 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0b337fbe-fe56-4f3e-a0db-ecd2e67c91af tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:50.719393 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0b337fbe-fe56-4f3e-a0db-ecd2e67c91af tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:50.720504 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0b337fbe-fe56-4f3e-a0db-ecd2e67c91af tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:50.721193 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-0b337fbe-fe56-4f3e-a0db-ecd2e67c91af tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:50.760149 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-0b337fbe-fe56-4f3e-a0db-ecd2e67c91af tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: e45f5939-6fc6-460e-add3-94d539493385] Going to try to terminate instance {{(pid=117087) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 20 20:13:51.067404 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-0b337fbe-fe56-4f3e-a0db-ecd2e67c91af tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385" status: 204 len: 0 microversion: 2.1 time: 0.359673 Feb 20 20:13:51.067621 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 559/1123] 10.222.0.60 () {58 vars in 1238 bytes} [Sun Feb 20 20:13:50 2022] DELETE /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 20 20:13:51.078931 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e356741e-1509-42ea-9d71-19f308aa6de4 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:51.079605 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e356741e-1509-42ea-9d71-19f308aa6de4 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: e45f5939-6fc6-460e-add3-94d539493385] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:51.087130 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e356741e-1509-42ea-9d71-19f308aa6de4 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:51.087612 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e356741e-1509-42ea-9d71-19f308aa6de4 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:51.088393 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e356741e-1509-42ea-9d71-19f308aa6de4 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:51.088835 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e356741e-1509-42ea-9d71-19f308aa6de4 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:51.255680 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e356741e-1509-42ea-9d71-19f308aa6de4 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:51.264337 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e356741e-1509-42ea-9d71-19f308aa6de4 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385" status: 200 len: 1514 microversion: 2.1 time: 0.190639 Feb 20 20:13:51.265321 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 565/1124] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:51 2022] GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385 => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:52.290468 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-04ae2b24-d9c6-49b2-aac7-4639fd7e8d55 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:52.291321 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-04ae2b24-d9c6-49b2-aac7-4639fd7e8d55 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: e45f5939-6fc6-460e-add3-94d539493385] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:52.299166 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-04ae2b24-d9c6-49b2-aac7-4639fd7e8d55 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:52.300099 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-04ae2b24-d9c6-49b2-aac7-4639fd7e8d55 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:52.301338 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-04ae2b24-d9c6-49b2-aac7-4639fd7e8d55 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:52.301886 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-04ae2b24-d9c6-49b2-aac7-4639fd7e8d55 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:52.514593 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-04ae2b24-d9c6-49b2-aac7-4639fd7e8d55 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:52.522309 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-04ae2b24-d9c6-49b2-aac7-4639fd7e8d55 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385" status: 200 len: 1514 microversion: 2.1 time: 0.237101 Feb 20 20:13:52.523095 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 560/1125] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:52 2022] GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385 => generated 1514 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:53.540105 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-199ba692-bc26-418f-85d2-c5ba66d8f496 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:53.540738 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-199ba692-bc26-418f-85d2-c5ba66d8f496 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: e45f5939-6fc6-460e-add3-94d539493385] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:53.548713 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-199ba692-bc26-418f-85d2-c5ba66d8f496 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:53.549190 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-199ba692-bc26-418f-85d2-c5ba66d8f496 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:53.550029 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-199ba692-bc26-418f-85d2-c5ba66d8f496 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:53.550532 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-199ba692-bc26-418f-85d2-c5ba66d8f496 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:53.737717 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-199ba692-bc26-418f-85d2-c5ba66d8f496 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:53.745614 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-199ba692-bc26-418f-85d2-c5ba66d8f496 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385" status: 200 len: 1514 microversion: 2.1 time: 0.209603 Feb 20 20:13:53.756446 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 566/1126] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:53 2022] GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385 => generated 1514 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:54.739878 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-6de57131-1156-4e0d-9233-7afe063aca1c req-4079887f-94c0-4498-944b-6c9f6cd828cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e45f5939-6fc6-460e-add3-94d539493385", "name": "network-vif-deleted", "tag": "8f48541a-1b0e-4f26-9749-d9f505869dbe"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:13:54.741570 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:13:54.741570 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:13:54.749399 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-6de57131-1156-4e0d-9233-7afe063aca1c req-4079887f-94c0-4498-944b-6c9f6cd828cd service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:54.749885 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-6de57131-1156-4e0d-9233-7afe063aca1c req-4079887f-94c0-4498-944b-6c9f6cd828cd service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:54.762564 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-6de57131-1156-4e0d-9233-7afe063aca1c req-4079887f-94c0-4498-944b-6c9f6cd828cd service nova] Creating event network-vif-deleted:8f48541a-1b0e-4f26-9749-d9f505869dbe for instance e45f5939-6fc6-460e-add3-94d539493385 on hv-cinder-83008 Feb 20 20:13:54.768535 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-6de57131-1156-4e0d-9233-7afe063aca1c req-4079887f-94c0-4498-944b-6c9f6cd828cd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032417 Feb 20 20:13:54.769400 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-07217748-0d31-4c3a-83da-f202b266ff9a tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:54.770019 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 561/1127] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:13:54.772289 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-07217748-0d31-4c3a-83da-f202b266ff9a tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: e45f5939-6fc6-460e-add3-94d539493385] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:54.781841 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-07217748-0d31-4c3a-83da-f202b266ff9a tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:54.782425 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-07217748-0d31-4c3a-83da-f202b266ff9a tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:54.783738 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-07217748-0d31-4c3a-83da-f202b266ff9a tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:54.784092 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-07217748-0d31-4c3a-83da-f202b266ff9a tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:54.866861 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-07217748-0d31-4c3a-83da-f202b266ff9a tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:54.875675 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-07217748-0d31-4c3a-83da-f202b266ff9a tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385" status: 200 len: 1472 microversion: 2.1 time: 0.114288 Feb 20 20:13:54.876153 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 567/1128] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:54 2022] GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385 => generated 1472 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:13:55.895308 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-4b2944a2-5ccf-4ec9-be17-ebc5773d2526 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:55.896251 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-4b2944a2-5ccf-4ec9-be17-ebc5773d2526 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: e45f5939-6fc6-460e-add3-94d539493385] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:55.907680 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4b2944a2-5ccf-4ec9-be17-ebc5773d2526 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:55.908126 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4b2944a2-5ccf-4ec9-be17-ebc5773d2526 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:55.912092 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4b2944a2-5ccf-4ec9-be17-ebc5773d2526 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:55.914135 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4b2944a2-5ccf-4ec9-be17-ebc5773d2526 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:55.963634 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4b2944a2-5ccf-4ec9-be17-ebc5773d2526 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:55.964486 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-4b2944a2-5ccf-4ec9-be17-ebc5773d2526 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:55.965256 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-4b2944a2-5ccf-4ec9-be17-ebc5773d2526 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lazy-loading 'fault' on Instance uuid e45f5939-6fc6-460e-add3-94d539493385 {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:13:56.020766 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-4b2944a2-5ccf-4ec9-be17-ebc5773d2526 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48726bef2dd64c6a89818ac908e20c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808529e78f784dc883aa61be87436be2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:13:56.031432 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-4b2944a2-5ccf-4ec9-be17-ebc5773d2526 tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385" status: 200 len: 1308 microversion: 2.1 time: 0.141120 Feb 20 20:13:56.032118 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 562/1129] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:55 2022] GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385 => generated 1308 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:13:57.052196 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-46c19b9b-faa4-40d7-a1c4-16762063a4ae tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:13:57.053392 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-46c19b9b-faa4-40d7-a1c4-16762063a4ae tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] [instance: e45f5939-6fc6-460e-add3-94d539493385] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:13:57.061707 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-46c19b9b-faa4-40d7-a1c4-16762063a4ae tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:57.062763 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-46c19b9b-faa4-40d7-a1c4-16762063a4ae tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:57.063742 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-46c19b9b-faa4-40d7-a1c4-16762063a4ae tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:13:57.064248 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-46c19b9b-faa4-40d7-a1c4-16762063a4ae tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:13:57.081334 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-46c19b9b-faa4-40d7-a1c4-16762063a4ae tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] HTTP exception thrown: Instance e45f5939-6fc6-460e-add3-94d539493385 could not be found. Feb 20 20:13:57.082366 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-46c19b9b-faa4-40d7-a1c4-16762063a4ae tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] Returning 404 to user: Instance e45f5939-6fc6-460e-add3-94d539493385 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:13:57.083268 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-46c19b9b-faa4-40d7-a1c4-16762063a4ae tempest-VolumesSnapshotTestJSON-1384716596 tempest-VolumesSnapshotTestJSON-1384716596-project] 10.222.0.60 "GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385" status: 404 len: 111 microversion: 2.1 time: 0.035648 Feb 20 20:13:57.084130 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 568/1130] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:13:57 2022] GET /compute/v2.1/servers/e45f5939-6fc6-460e-add3-94d539493385 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:14:27.050889 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 20 20:14:27.051660 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: Sun Feb 20 20:14:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 20 20:14:48.738106 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-2afa3a48-50b3-4835-b3cd-479ce62141c6 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1585792497"}} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:14:48.738756 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-2afa3a48-50b3-4835-b3cd-479ce62141c6 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:14:48.745720 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2afa3a48-50b3-4835-b3cd-479ce62141c6 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:48.746167 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2afa3a48-50b3-4835-b3cd-479ce62141c6 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:48.746996 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2afa3a48-50b3-4835-b3cd-479ce62141c6 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:48.747426 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-2afa3a48-50b3-4835-b3cd-479ce62141c6 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:48.912385 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.network.security_group_api [None req-2afa3a48-50b3-4835-b3cd-479ce62141c6 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Removing security group c2920800-f7be-4bd5-b062-b18745f13acb from port cfccf2b7-f03a-45d7-9992-17e3e6423c6e Feb 20 20:14:49.434589 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-2afa3a48-50b3-4835-b3cd-479ce62141c6 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "POST /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c/action" status: 202 len: 0 microversion: 2.1 time: 0.700806 Feb 20 20:14:49.436584 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 563/1131] 10.222.0.60 () {60 vars in 1277 bytes} [Sun Feb 20 20:14:48 2022] POST /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c/action => generated 0 bytes in 704 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:14:49.771025 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-0162a56b-69a5-46ae-a94b-b0b069cf4661 req-6125825c-9ec1-42f5-bb62-afdc5973b9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba5af9c-b81f-42b1-bf96-26206c4e495c", "tag": "cfccf2b7-f03a-45d7-9992-17e3e6423c6e"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:14:49.773217 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:14:49.773217 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:14:49.785584 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-0162a56b-69a5-46ae-a94b-b0b069cf4661 req-6125825c-9ec1-42f5-bb62-afdc5973b9f6 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:49.796225 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-0162a56b-69a5-46ae-a94b-b0b069cf4661 req-6125825c-9ec1-42f5-bb62-afdc5973b9f6 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:49.802931 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-0162a56b-69a5-46ae-a94b-b0b069cf4661 req-6125825c-9ec1-42f5-bb62-afdc5973b9f6 service nova] Creating event network-changed:cfccf2b7-f03a-45d7-9992-17e3e6423c6e for instance 7ba5af9c-b81f-42b1-bf96-26206c4e495c on hv-cinder-83008 Feb 20 20:14:49.810488 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-0162a56b-69a5-46ae-a94b-b0b069cf4661 req-6125825c-9ec1-42f5-bb62-afdc5973b9f6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.368346 Feb 20 20:14:49.811800 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 569/1132] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:14:51.095931 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-ca947688-45f2-49a8-93f0-d6a1ab334268 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:14:51.096647 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-ca947688-45f2-49a8-93f0-d6a1ab334268 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:14:51.103678 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ca947688-45f2-49a8-93f0-d6a1ab334268 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:51.103678 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ca947688-45f2-49a8-93f0-d6a1ab334268 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:51.104522 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ca947688-45f2-49a8-93f0-d6a1ab334268 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:51.104954 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-ca947688-45f2-49a8-93f0-d6a1ab334268 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:51.215962 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-ca947688-45f2-49a8-93f0-d6a1ab334268 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lazy-loading 'services' on Instance uuid 7ba5af9c-b81f-42b1-bf96-26206c4e495c {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:14:51.513318 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-ca947688-45f2-49a8-93f0-d6a1ab334268 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c/os-volume_attachments/7dc56315-bb8d-4f48-a6d1-283dd2c83385" status: 202 len: 0 microversion: 2.1 time: 0.422016 Feb 20 20:14:51.533454 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-320e4ead-f4c7-409e-8878-a52d8044e910 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:14:51.535092 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-320e4ead-f4c7-409e-8878-a52d8044e910 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:14:51.540405 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 564/1133] 10.222.0.60 () {58 vars in 1415 bytes} [Sun Feb 20 20:14:51 2022] DELETE /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c/os-volume_attachments/7dc56315-bb8d-4f48-a6d1-283dd2c83385 => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:14:51.546382 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-320e4ead-f4c7-409e-8878-a52d8044e910 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:51.547023 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-320e4ead-f4c7-409e-8878-a52d8044e910 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:51.547980 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-320e4ead-f4c7-409e-8878-a52d8044e910 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:51.548635 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-320e4ead-f4c7-409e-8878-a52d8044e910 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:51.587095 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-320e4ead-f4c7-409e-8878-a52d8044e910 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065186 Feb 20 20:14:51.587512 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 570/1134] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:14:51 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:14:51.827932 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-2260db22-2bcc-49bf-b399-9d089f4cc004 req-354cc61e-a8d7-4f35-af9c-b70c34f3948b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba5af9c-b81f-42b1-bf96-26206c4e495c", "tag": "cfccf2b7-f03a-45d7-9992-17e3e6423c6e"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:14:51.830118 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:14:51.830118 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:14:51.849790 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-2260db22-2bcc-49bf-b399-9d089f4cc004 req-354cc61e-a8d7-4f35-af9c-b70c34f3948b service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:51.849790 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-2260db22-2bcc-49bf-b399-9d089f4cc004 req-354cc61e-a8d7-4f35-af9c-b70c34f3948b service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:51.854991 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-2260db22-2bcc-49bf-b399-9d089f4cc004 req-354cc61e-a8d7-4f35-af9c-b70c34f3948b service nova] Creating event network-changed:cfccf2b7-f03a-45d7-9992-17e3e6423c6e for instance 7ba5af9c-b81f-42b1-bf96-26206c4e495c on hv-cinder-83008 Feb 20 20:14:51.859810 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-2260db22-2bcc-49bf-b399-9d089f4cc004 req-354cc61e-a8d7-4f35-af9c-b70c34f3948b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035834 Feb 20 20:14:51.860409 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 565/1135] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:14:52.607350 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-90708297-fc92-463c-a7df-dc7b120e1723 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:14:52.608355 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-90708297-fc92-463c-a7df-dc7b120e1723 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:14:52.614712 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-90708297-fc92-463c-a7df-dc7b120e1723 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:52.615152 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-90708297-fc92-463c-a7df-dc7b120e1723 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:52.615997 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-90708297-fc92-463c-a7df-dc7b120e1723 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:52.616430 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-90708297-fc92-463c-a7df-dc7b120e1723 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:52.647089 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-90708297-fc92-463c-a7df-dc7b120e1723 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043762 Feb 20 20:14:52.647716 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 571/1136] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:14:52 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:14:53.663969 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-a3260ea4-7d25-4232-b04a-0ae8973c0830 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:14:53.665668 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-a3260ea4-7d25-4232-b04a-0ae8973c0830 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:14:53.673001 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a3260ea4-7d25-4232-b04a-0ae8973c0830 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:53.673643 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a3260ea4-7d25-4232-b04a-0ae8973c0830 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:53.674546 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a3260ea4-7d25-4232-b04a-0ae8973c0830 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:53.675031 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-a3260ea4-7d25-4232-b04a-0ae8973c0830 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:53.706255 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-a3260ea4-7d25-4232-b04a-0ae8973c0830 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047401 Feb 20 20:14:53.706818 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 566/1137] 10.222.0.60 () {58 vars in 1301 bytes} [Sun Feb 20 20:14:53 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 20 20:14:53.719322 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f4794bba-b44f-4f8c-8945-da4c8a63e437 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:14:53.719899 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f4794bba-b44f-4f8c-8945-da4c8a63e437 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:14:53.728388 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f4794bba-b44f-4f8c-8945-da4c8a63e437 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:53.735795 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f4794bba-b44f-4f8c-8945-da4c8a63e437 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:53.735795 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f4794bba-b44f-4f8c-8945-da4c8a63e437 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:53.735795 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f4794bba-b44f-4f8c-8945-da4c8a63e437 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:53.815985 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-f4794bba-b44f-4f8c-8945-da4c8a63e437 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] HTTP exception thrown: Instance 7ba5af9c-b81f-42b1-bf96-26206c4e495c is not attached to volume 7dc56315-bb8d-4f48-a6d1-283dd2c83385 Feb 20 20:14:53.815985 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f4794bba-b44f-4f8c-8945-da4c8a63e437 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Returning 404 to user: Instance 7ba5af9c-b81f-42b1-bf96-26206c4e495c is not attached to volume 7dc56315-bb8d-4f48-a6d1-283dd2c83385 {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:14:53.815985 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f4794bba-b44f-4f8c-8945-da4c8a63e437 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c/os-volume_attachments/7dc56315-bb8d-4f48-a6d1-283dd2c83385" status: 404 len: 154 microversion: 2.1 time: 0.099121 Feb 20 20:14:53.815985 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 572/1138] 10.222.0.60 () {58 vars in 1415 bytes} [Sun Feb 20 20:14:53 2022] DELETE /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c/os-volume_attachments/7dc56315-bb8d-4f48-a6d1-283dd2c83385 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:14:55.226764 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-b419ab49-b5ba-42a4-8580-f00f5086708a tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:14:55.227585 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b419ab49-b5ba-42a4-8580-f00f5086708a tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:14:55.234034 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b419ab49-b5ba-42a4-8580-f00f5086708a tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:55.234481 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b419ab49-b5ba-42a4-8580-f00f5086708a tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:55.235330 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b419ab49-b5ba-42a4-8580-f00f5086708a tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:55.235754 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-b419ab49-b5ba-42a4-8580-f00f5086708a tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:55.262343 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-b419ab49-b5ba-42a4-8580-f00f5086708a tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Going to try to terminate instance {{(pid=117087) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 20 20:14:55.577912 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-b419ab49-b5ba-42a4-8580-f00f5086708a tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 204 len: 0 microversion: 2.1 time: 0.354785 Feb 20 20:14:55.578792 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 567/1139] 10.222.0.60 () {58 vars in 1238 bytes} [Sun Feb 20 20:14:55 2022] DELETE /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 20 20:14:55.586903 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f173a29d-3168-477a-ad98-89dcca525045 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:14:55.588042 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f173a29d-3168-477a-ad98-89dcca525045 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:14:55.594560 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f173a29d-3168-477a-ad98-89dcca525045 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:55.595095 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f173a29d-3168-477a-ad98-89dcca525045 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:55.595988 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f173a29d-3168-477a-ad98-89dcca525045 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:55.596482 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f173a29d-3168-477a-ad98-89dcca525045 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:55.751210 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-f173a29d-3168-477a-ad98-89dcca525045 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:14:55.759920 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f173a29d-3168-477a-ad98-89dcca525045 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1555 microversion: 2.1 time: 0.176824 Feb 20 20:14:55.760511 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 573/1140] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:14:55 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1555 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:14:56.779208 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d916b234-b8ef-4ef6-840b-5791cee606fc tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:14:56.779826 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d916b234-b8ef-4ef6-840b-5791cee606fc tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:14:56.786532 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d916b234-b8ef-4ef6-840b-5791cee606fc tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:56.786798 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d916b234-b8ef-4ef6-840b-5791cee606fc tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:56.787666 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d916b234-b8ef-4ef6-840b-5791cee606fc tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:56.788117 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d916b234-b8ef-4ef6-840b-5791cee606fc tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:56.936189 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d916b234-b8ef-4ef6-840b-5791cee606fc tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:14:56.943668 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d916b234-b8ef-4ef6-840b-5791cee606fc tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1555 microversion: 2.1 time: 0.168652 Feb 20 20:14:56.944237 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 568/1141] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:14:56 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:14:57.960649 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-49db093f-d5ff-4443-9935-ae95a81182b8 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:14:57.962245 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-49db093f-d5ff-4443-9935-ae95a81182b8 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:14:57.968761 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-49db093f-d5ff-4443-9935-ae95a81182b8 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:57.969244 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-49db093f-d5ff-4443-9935-ae95a81182b8 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:57.970027 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-49db093f-d5ff-4443-9935-ae95a81182b8 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:57.970466 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-49db093f-d5ff-4443-9935-ae95a81182b8 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:58.124781 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-49db093f-d5ff-4443-9935-ae95a81182b8 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:14:58.132849 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-49db093f-d5ff-4443-9935-ae95a81182b8 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1555 microversion: 2.1 time: 0.175685 Feb 20 20:14:58.142425 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 574/1142] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:14:57 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:14:58.329487 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-ea344860-e9f2-491f-8a59-802f7266dd53 req-ee052736-bf03-4800-8290-853ecc91e465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba5af9c-b81f-42b1-bf96-26206c4e495c", "name": "network-vif-deleted", "tag": "cfccf2b7-f03a-45d7-9992-17e3e6423c6e"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:14:58.330983 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:14:58.330983 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:14:58.339964 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-ea344860-e9f2-491f-8a59-802f7266dd53 req-ee052736-bf03-4800-8290-853ecc91e465 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:58.340498 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-ea344860-e9f2-491f-8a59-802f7266dd53 req-ee052736-bf03-4800-8290-853ecc91e465 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:58.352953 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-ea344860-e9f2-491f-8a59-802f7266dd53 req-ee052736-bf03-4800-8290-853ecc91e465 service nova] Creating event network-vif-deleted:cfccf2b7-f03a-45d7-9992-17e3e6423c6e for instance 7ba5af9c-b81f-42b1-bf96-26206c4e495c on hv-cinder-83008 Feb 20 20:14:58.358794 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-ea344860-e9f2-491f-8a59-802f7266dd53 req-ee052736-bf03-4800-8290-853ecc91e465 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032973 Feb 20 20:14:58.359413 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 569/1143] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:14:59.150823 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-852caff1-880e-4600-a9e2-84ae52a6f7b9 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:14:59.151612 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-852caff1-880e-4600-a9e2-84ae52a6f7b9 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:14:59.158465 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-852caff1-880e-4600-a9e2-84ae52a6f7b9 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:59.158574 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-852caff1-880e-4600-a9e2-84ae52a6f7b9 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:59.159350 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-852caff1-880e-4600-a9e2-84ae52a6f7b9 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:59.159785 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-852caff1-880e-4600-a9e2-84ae52a6f7b9 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:59.192905 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-852caff1-880e-4600-a9e2-84ae52a6f7b9 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:14:59.193387 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-852caff1-880e-4600-a9e2-84ae52a6f7b9 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:14:59.193843 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-852caff1-880e-4600-a9e2-84ae52a6f7b9 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lazy-loading 'fault' on Instance uuid 7ba5af9c-b81f-42b1-bf96-26206c4e495c {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:14:59.238893 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-852caff1-880e-4600-a9e2-84ae52a6f7b9 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '115f83923a084af2a813b977f2457834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c045506d99f44170a1ba8efc46b78ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:14:59.246949 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-852caff1-880e-4600-a9e2-84ae52a6f7b9 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 200 len: 1348 microversion: 2.1 time: 0.100453 Feb 20 20:14:59.247852 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 575/1144] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:14:59 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 1348 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:15:00.264245 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6ef8dc09-9f22-450b-ad4a-032cc0bcac32 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:15:00.265122 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-6ef8dc09-9f22-450b-ad4a-032cc0bcac32 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] [instance: 7ba5af9c-b81f-42b1-bf96-26206c4e495c] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:15:00.272621 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6ef8dc09-9f22-450b-ad4a-032cc0bcac32 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:00.273165 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6ef8dc09-9f22-450b-ad4a-032cc0bcac32 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:00.273878 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6ef8dc09-9f22-450b-ad4a-032cc0bcac32 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:00.274394 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-6ef8dc09-9f22-450b-ad4a-032cc0bcac32 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:00.291887 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-6ef8dc09-9f22-450b-ad4a-032cc0bcac32 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] HTTP exception thrown: Instance 7ba5af9c-b81f-42b1-bf96-26206c4e495c could not be found. Feb 20 20:15:00.292473 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-6ef8dc09-9f22-450b-ad4a-032cc0bcac32 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Returning 404 to user: Instance 7ba5af9c-b81f-42b1-bf96-26206c4e495c could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:15:00.293339 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-6ef8dc09-9f22-450b-ad4a-032cc0bcac32 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c" status: 404 len: 111 microversion: 2.1 time: 0.033581 Feb 20 20:15:00.293892 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 570/1145] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:15:00 2022] GET /compute/v2.1/servers/7ba5af9c-b81f-42b1-bf96-26206c4e495c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 20 20:15:00.302147 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-ab5cad06-d39f-4a25-a574-ac979f638b36 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] Calling method '.version_select at 0x7fdd913d4550>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:15:00.421372 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-ab5cad06-d39f-4a25-a574-ac979f638b36 tempest-TestMinimumBasicScenario-2011436987 tempest-TestMinimumBasicScenario-2011436987-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-618810537" status: 202 len: 0 microversion: 2.1 time: 0.123029 Feb 20 20:15:00.421973 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 576/1146] 10.222.0.60 () {58 vars in 1268 bytes} [Sun Feb 20 20:15:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-618810537 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:15:23.546577 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-79208df4-3b92-4b16-8f3e-fbe27c50989f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:15:23.547155 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-79208df4-3b92-4b16-8f3e-fbe27c50989f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:15:23.549645 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-bd0815a3-c8b4-4aeb-83b7-9ce15cb6416c req-73087d6f-66f6-46f4-99b8-e21878867e7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "411a5340-f73c-40a1-b198-ead1269694e3", "tag": "10ac2204-83c7-4ce9-bf10-af82dd0b521e"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:15:23.551914 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:15:23.551914 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:15:23.553331 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-79208df4-3b92-4b16-8f3e-fbe27c50989f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:23.553785 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-79208df4-3b92-4b16-8f3e-fbe27c50989f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:23.554648 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-79208df4-3b92-4b16-8f3e-fbe27c50989f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:23.556121 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-79208df4-3b92-4b16-8f3e-fbe27c50989f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:23.563265 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-bd0815a3-c8b4-4aeb-83b7-9ce15cb6416c req-73087d6f-66f6-46f4-99b8-e21878867e7b service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:23.563792 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-bd0815a3-c8b4-4aeb-83b7-9ce15cb6416c req-73087d6f-66f6-46f4-99b8-e21878867e7b service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:23.575501 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-bd0815a3-c8b4-4aeb-83b7-9ce15cb6416c req-73087d6f-66f6-46f4-99b8-e21878867e7b service nova] Creating event network-changed:10ac2204-83c7-4ce9-bf10-af82dd0b521e for instance 411a5340-f73c-40a1-b198-ead1269694e3 on hv-cinder-83008 Feb 20 20:15:23.581060 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-bd0815a3-c8b4-4aeb-83b7-9ce15cb6416c req-73087d6f-66f6-46f4-99b8-e21878867e7b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036363 Feb 20 20:15:23.582159 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 577/1147] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 20 20:15:23.593316 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-79208df4-3b92-4b16-8f3e-fbe27c50989f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Going to try to terminate instance {{(pid=117087) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 20 20:15:24.080640 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-79208df4-3b92-4b16-8f3e-fbe27c50989f tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "DELETE /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 204 len: 0 microversion: 2.1 time: 0.537820 Feb 20 20:15:24.082171 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 571/1148] 10.222.0.60 () {58 vars in 1238 bytes} [Sun Feb 20 20:15:23 2022] DELETE /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 20 20:15:24.090671 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-a268cd6b-07e3-4157-95e6-977c5a5c79d5 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:15:24.091419 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-a268cd6b-07e3-4157-95e6-977c5a5c79d5 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:15:24.097901 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a268cd6b-07e3-4157-95e6-977c5a5c79d5 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:24.098666 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a268cd6b-07e3-4157-95e6-977c5a5c79d5 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:24.099669 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a268cd6b-07e3-4157-95e6-977c5a5c79d5 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:24.100108 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-a268cd6b-07e3-4157-95e6-977c5a5c79d5 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:24.249806 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-a268cd6b-07e3-4157-95e6-977c5a5c79d5 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:15:24.261774 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-a268cd6b-07e3-4157-95e6-977c5a5c79d5 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1577 microversion: 2.1 time: 0.175965 Feb 20 20:15:24.265160 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 578/1149] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:15:24 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 20 20:15:25.280524 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-1a778e04-d07d-4ca8-a7f2-63f54b53585e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:15:25.281256 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-1a778e04-d07d-4ca8-a7f2-63f54b53585e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:15:25.287536 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1a778e04-d07d-4ca8-a7f2-63f54b53585e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:25.287987 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1a778e04-d07d-4ca8-a7f2-63f54b53585e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:25.288827 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1a778e04-d07d-4ca8-a7f2-63f54b53585e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:25.289826 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-1a778e04-d07d-4ca8-a7f2-63f54b53585e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:25.437758 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-1a778e04-d07d-4ca8-a7f2-63f54b53585e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:15:25.445049 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-1a778e04-d07d-4ca8-a7f2-63f54b53585e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1458 microversion: 2.1 time: 0.169468 Feb 20 20:15:25.445729 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 572/1150] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:15:25 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1458 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:15:26.378572 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [req-f0b7e8d3-06dd-408a-ac02-68c527fbcccd req-3c96a52f-72f7-4e4d-819e-aaeff2a64409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "411a5340-f73c-40a1-b198-ead1269694e3", "name": "network-vif-deleted", "tag": "10ac2204-83c7-4ce9-bf10-af82dd0b521e"}]} {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:15:26.380129 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:15:26.380129 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: warnings.warn(msg) Feb 20 20:15:26.388238 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-f0b7e8d3-06dd-408a-ac02-68c527fbcccd req-3c96a52f-72f7-4e4d-819e-aaeff2a64409 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:26.388676 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [req-f0b7e8d3-06dd-408a-ac02-68c527fbcccd req-3c96a52f-72f7-4e4d-819e-aaeff2a64409 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:26.401051 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.compute.server_external_events [req-f0b7e8d3-06dd-408a-ac02-68c527fbcccd req-3c96a52f-72f7-4e4d-819e-aaeff2a64409 service nova] Creating event network-vif-deleted:10ac2204-83c7-4ce9-bf10-af82dd0b521e for instance 411a5340-f73c-40a1-b198-ead1269694e3 on hv-cinder-83008 Feb 20 20:15:26.406159 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [req-f0b7e8d3-06dd-408a-ac02-68c527fbcccd req-3c96a52f-72f7-4e4d-819e-aaeff2a64409 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031127 Feb 20 20:15:26.406753 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 579/1151] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:15:26.463750 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d17eeb5e-3e52-4b11-ad02-08c35e73eea5 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:15:26.464493 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d17eeb5e-3e52-4b11-ad02-08c35e73eea5 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:15:26.471641 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d17eeb5e-3e52-4b11-ad02-08c35e73eea5 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:26.472092 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d17eeb5e-3e52-4b11-ad02-08c35e73eea5 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:26.472879 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d17eeb5e-3e52-4b11-ad02-08c35e73eea5 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:26.473355 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d17eeb5e-3e52-4b11-ad02-08c35e73eea5 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:26.541332 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d17eeb5e-3e52-4b11-ad02-08c35e73eea5 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:15:26.548760 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d17eeb5e-3e52-4b11-ad02-08c35e73eea5 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1390 microversion: 2.1 time: 0.089571 Feb 20 20:15:26.551887 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 573/1152] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:15:26 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:15:27.567631 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8688ca9d-d033-4d0d-ad28-a4ba39c9c25d tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:15:27.568333 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8688ca9d-d033-4d0d-ad28-a4ba39c9c25d tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:15:27.575311 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8688ca9d-d033-4d0d-ad28-a4ba39c9c25d tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:27.575761 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8688ca9d-d033-4d0d-ad28-a4ba39c9c25d tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:27.576559 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8688ca9d-d033-4d0d-ad28-a4ba39c9c25d tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:27.576980 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8688ca9d-d033-4d0d-ad28-a4ba39c9c25d tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:27.607690 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8688ca9d-d033-4d0d-ad28-a4ba39c9c25d tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:27.608133 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8688ca9d-d033-4d0d-ad28-a4ba39c9c25d tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:27.608576 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.objects.instance [None req-8688ca9d-d033-4d0d-ad28-a4ba39c9c25d tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lazy-loading 'fault' on Instance uuid 411a5340-f73c-40a1-b198-ead1269694e3 {{(pid=117088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:15:27.650756 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-8688ca9d-d033-4d0d-ad28-a4ba39c9c25d tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:15:27.658301 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8688ca9d-d033-4d0d-ad28-a4ba39c9c25d tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 200 len: 1230 microversion: 2.1 time: 0.095102 Feb 20 20:15:27.658895 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 580/1153] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:15:27 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:15:28.678821 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-96e51bea-e0ab-428f-bcff-3dba2f8263ff tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:15:28.679413 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-96e51bea-e0ab-428f-bcff-3dba2f8263ff tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 411a5340-f73c-40a1-b198-ead1269694e3] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:15:28.686430 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-96e51bea-e0ab-428f-bcff-3dba2f8263ff tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:28.686904 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-96e51bea-e0ab-428f-bcff-3dba2f8263ff tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:28.687672 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-96e51bea-e0ab-428f-bcff-3dba2f8263ff tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:28.688097 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-96e51bea-e0ab-428f-bcff-3dba2f8263ff tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:28.702190 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-96e51bea-e0ab-428f-bcff-3dba2f8263ff tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] HTTP exception thrown: Instance 411a5340-f73c-40a1-b198-ead1269694e3 could not be found. Feb 20 20:15:28.702798 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-96e51bea-e0ab-428f-bcff-3dba2f8263ff tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Returning 404 to user: Instance 411a5340-f73c-40a1-b198-ead1269694e3 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:15:28.703638 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-96e51bea-e0ab-428f-bcff-3dba2f8263ff tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3" status: 404 len: 111 microversion: 2.1 time: 0.029157 Feb 20 20:15:28.704165 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 574/1154] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:15:28 2022] GET /compute/v2.1/servers/411a5340-f73c-40a1-b198-ead1269694e3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:15:32.543972 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-8aa91666-cc88-4f7a-82db-ad97f40a8c6e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:15:32.544543 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8aa91666-cc88-4f7a-82db-ad97f40a8c6e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:15:32.546184 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-71134bdd-bd25-4227-ad9f-a2d42abdf4c9 req-d380f0ec-7204-480f-8593-09ce832e7ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c5dc901-3328-47a3-949d-97b1d3fd0f85", "tag": "9bb3be73-8f90-429e-b3c4-1a5cc212a013"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:15:32.547783 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:15:32.547783 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:15:32.551430 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8aa91666-cc88-4f7a-82db-ad97f40a8c6e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:32.551952 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8aa91666-cc88-4f7a-82db-ad97f40a8c6e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:32.552806 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8aa91666-cc88-4f7a-82db-ad97f40a8c6e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:32.553354 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-8aa91666-cc88-4f7a-82db-ad97f40a8c6e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:32.555666 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-71134bdd-bd25-4227-ad9f-a2d42abdf4c9 req-d380f0ec-7204-480f-8593-09ce832e7ab6 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:32.556112 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-71134bdd-bd25-4227-ad9f-a2d42abdf4c9 req-d380f0ec-7204-480f-8593-09ce832e7ab6 service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:32.568468 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-71134bdd-bd25-4227-ad9f-a2d42abdf4c9 req-d380f0ec-7204-480f-8593-09ce832e7ab6 service nova] Creating event network-changed:9bb3be73-8f90-429e-b3c4-1a5cc212a013 for instance 0c5dc901-3328-47a3-949d-97b1d3fd0f85 on hv-cinder-83008 Feb 20 20:15:32.574668 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-71134bdd-bd25-4227-ad9f-a2d42abdf4c9 req-d380f0ec-7204-480f-8593-09ce832e7ab6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032139 Feb 20 20:15:32.575275 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 575/1155] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:15:32.585146 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-8aa91666-cc88-4f7a-82db-ad97f40a8c6e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Going to try to terminate instance {{(pid=117088) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 20 20:15:33.041371 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-8aa91666-cc88-4f7a-82db-ad97f40a8c6e tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 204 len: 0 microversion: 2.1 time: 0.500536 Feb 20 20:15:33.041660 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 581/1156] 10.222.0.60 () {58 vars in 1238 bytes} [Sun Feb 20 20:15:32 2022] DELETE /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 20 20:15:33.050593 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d770029c-21f6-4219-9c8c-62a5d6a1fa2b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:15:33.051327 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d770029c-21f6-4219-9c8c-62a5d6a1fa2b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:15:33.058498 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d770029c-21f6-4219-9c8c-62a5d6a1fa2b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:33.058947 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d770029c-21f6-4219-9c8c-62a5d6a1fa2b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:33.059755 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d770029c-21f6-4219-9c8c-62a5d6a1fa2b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:33.060235 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d770029c-21f6-4219-9c8c-62a5d6a1fa2b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:33.218917 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d770029c-21f6-4219-9c8c-62a5d6a1fa2b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:15:33.227176 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d770029c-21f6-4219-9c8c-62a5d6a1fa2b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1577 microversion: 2.1 time: 0.180669 Feb 20 20:15:33.227993 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 576/1157] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:15:33 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:15:34.246114 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-b3d70bd1-3133-4c3e-b5af-149af226a80c tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:15:34.246820 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-b3d70bd1-3133-4c3e-b5af-149af226a80c tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:15:34.253360 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b3d70bd1-3133-4c3e-b5af-149af226a80c tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:34.253798 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b3d70bd1-3133-4c3e-b5af-149af226a80c tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:34.254590 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b3d70bd1-3133-4c3e-b5af-149af226a80c tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:34.255021 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-b3d70bd1-3133-4c3e-b5af-149af226a80c tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:34.400822 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-b3d70bd1-3133-4c3e-b5af-149af226a80c tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:15:34.408603 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-b3d70bd1-3133-4c3e-b5af-149af226a80c tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1458 microversion: 2.1 time: 0.167470 Feb 20 20:15:34.409213 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 582/1158] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:15:34 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1458 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:15:35.286202 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [req-10efb4fe-3654-43e7-9daa-c3d8f6d448f3 req-4292f669-aff2-4d36-8a5f-9ae91bbf152b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c5dc901-3328-47a3-949d-97b1d3fd0f85", "name": "network-vif-deleted", "tag": "9bb3be73-8f90-429e-b3c4-1a5cc212a013"}]} {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 20 20:15:35.287732 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 20 20:15:35.287732 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: warnings.warn(msg) Feb 20 20:15:35.295393 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-10efb4fe-3654-43e7-9daa-c3d8f6d448f3 req-4292f669-aff2-4d36-8a5f-9ae91bbf152b service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:35.295837 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [req-10efb4fe-3654-43e7-9daa-c3d8f6d448f3 req-4292f669-aff2-4d36-8a5f-9ae91bbf152b service nova] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:35.307387 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.compute.server_external_events [req-10efb4fe-3654-43e7-9daa-c3d8f6d448f3 req-4292f669-aff2-4d36-8a5f-9ae91bbf152b service nova] Creating event network-vif-deleted:9bb3be73-8f90-429e-b3c4-1a5cc212a013 for instance 0c5dc901-3328-47a3-949d-97b1d3fd0f85 on hv-cinder-83008 Feb 20 20:15:35.312881 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [req-10efb4fe-3654-43e7-9daa-c3d8f6d448f3 req-4292f669-aff2-4d36-8a5f-9ae91bbf152b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030125 Feb 20 20:15:35.313934 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 577/1159] 10.222.0.60 () {64 vars in 1317 bytes} [Sun Feb 20 20:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 20 20:15:35.426553 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e3222c50-5c3e-407f-9f85-b07e040073b0 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:15:35.427159 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e3222c50-5c3e-407f-9f85-b07e040073b0 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:15:35.434099 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e3222c50-5c3e-407f-9f85-b07e040073b0 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:35.434544 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e3222c50-5c3e-407f-9f85-b07e040073b0 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:35.435316 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e3222c50-5c3e-407f-9f85-b07e040073b0 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:35.435746 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e3222c50-5c3e-407f-9f85-b07e040073b0 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:35.498952 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.policy [None req-e3222c50-5c3e-407f-9f85-b07e040073b0 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117088) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:15:35.506478 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e3222c50-5c3e-407f-9f85-b07e040073b0 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1390 microversion: 2.1 time: 0.083554 Feb 20 20:15:35.507065 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 583/1160] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:15:35 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:15:36.524460 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d3923204-5d42-408c-852c-17fb5cdbd6eb tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:15:36.525830 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-d3923204-5d42-408c-852c-17fb5cdbd6eb tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:15:36.532736 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d3923204-5d42-408c-852c-17fb5cdbd6eb tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:36.533206 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d3923204-5d42-408c-852c-17fb5cdbd6eb tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:36.533989 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d3923204-5d42-408c-852c-17fb5cdbd6eb tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:36.534428 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d3923204-5d42-408c-852c-17fb5cdbd6eb tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:36.571269 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d3923204-5d42-408c-852c-17fb5cdbd6eb tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:36.571712 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-d3923204-5d42-408c-852c-17fb5cdbd6eb tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:36.573033 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.objects.instance [None req-d3923204-5d42-408c-852c-17fb5cdbd6eb tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lazy-loading 'fault' on Instance uuid 0c5dc901-3328-47a3-949d-97b1d3fd0f85 {{(pid=117087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 20 20:15:36.618824 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.policy [None req-d3923204-5d42-408c-852c-17fb5cdbd6eb tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b3136320e64532991e5dd5a199e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d15dcb9692c401e9d0e06361839bb8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117087) authorize /opt/stack/nova/nova/policy.py:199}} Feb 20 20:15:36.629024 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d3923204-5d42-408c-852c-17fb5cdbd6eb tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 200 len: 1230 microversion: 2.1 time: 0.108348 Feb 20 20:15:36.629980 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 578/1161] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:15:36 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 1230 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 20 20:15:37.648257 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e7bb78b3-d7b5-429b-9bc2-42c9f6f56c04 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:15:37.648859 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-e7bb78b3-d7b5-429b-9bc2-42c9f6f56c04 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 0c5dc901-3328-47a3-949d-97b1d3fd0f85] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:15:37.654717 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e7bb78b3-d7b5-429b-9bc2-42c9f6f56c04 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:37.655152 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e7bb78b3-d7b5-429b-9bc2-42c9f6f56c04 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:37.655911 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e7bb78b3-d7b5-429b-9bc2-42c9f6f56c04 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:37.656335 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-e7bb78b3-d7b5-429b-9bc2-42c9f6f56c04 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:37.669004 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-e7bb78b3-d7b5-429b-9bc2-42c9f6f56c04 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] HTTP exception thrown: Instance 0c5dc901-3328-47a3-949d-97b1d3fd0f85 could not be found. Feb 20 20:15:37.669601 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-e7bb78b3-d7b5-429b-9bc2-42c9f6f56c04 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Returning 404 to user: Instance 0c5dc901-3328-47a3-949d-97b1d3fd0f85 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:15:37.670405 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-e7bb78b3-d7b5-429b-9bc2-42c9f6f56c04 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85" status: 404 len: 111 microversion: 2.1 time: 0.026024 Feb 20 20:15:37.670927 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 584/1162] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:15:37 2022] GET /compute/v2.1/servers/0c5dc901-3328-47a3-949d-97b1d3fd0f85 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:15:38.194016 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c0806416-7410-4251-95d4-806eb057bd1b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:15:38.194811 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.compute.api [None req-c0806416-7410-4251-95d4-806eb057bd1b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117087) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:15:38.202049 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c0806416-7410-4251-95d4-806eb057bd1b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:38.202583 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c0806416-7410-4251-95d4-806eb057bd1b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:38.203449 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c0806416-7410-4251-95d4-806eb057bd1b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:38.204035 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG oslo_concurrency.lockutils [None req-c0806416-7410-4251-95d4-806eb057bd1b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:38.219305 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.wsgi [None req-c0806416-7410-4251-95d4-806eb057bd1b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] HTTP exception thrown: Instance 14017978-5ca1-41e3-9cee-2b9fe9d737d3 could not be found. Feb 20 20:15:38.220008 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-c0806416-7410-4251-95d4-806eb057bd1b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Returning 404 to user: Instance 14017978-5ca1-41e3-9cee-2b9fe9d737d3 could not be found. {{(pid=117087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:15:38.220905 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-c0806416-7410-4251-95d4-806eb057bd1b tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "DELETE /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 404 len: 111 microversion: 2.1 time: 0.030638 Feb 20 20:15:38.221596 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 579/1163] 10.222.0.60 () {58 vars in 1238 bytes} [Sun Feb 20 20:15:38 2022] DELETE /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 20 20:15:38.230008 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f3f13d8a-d1c8-4c9a-8857-9bf46ef2794a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '>' {{(pid=117088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:15:38.230843 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.compute.api [None req-f3f13d8a-d1c8-4c9a-8857-9bf46ef2794a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] [instance: 14017978-5ca1-41e3-9cee-2b9fe9d737d3] Fetching instance by UUID {{(pid=117088) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 20 20:15:38.237181 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f3f13d8a-d1c8-4c9a-8857-9bf46ef2794a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:38.237631 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f3f13d8a-d1c8-4c9a-8857-9bf46ef2794a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:38.238405 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f3f13d8a-d1c8-4c9a-8857-9bf46ef2794a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 20 20:15:38.238839 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG oslo_concurrency.lockutils [None req-f3f13d8a-d1c8-4c9a-8857-9bf46ef2794a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Lock "84b2375e-72b1-4ebf-b9cd-f9882b4f07ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 20 20:15:38.252912 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.wsgi [None req-f3f13d8a-d1c8-4c9a-8857-9bf46ef2794a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] HTTP exception thrown: Instance 14017978-5ca1-41e3-9cee-2b9fe9d737d3 could not be found. Feb 20 20:15:38.253534 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: DEBUG nova.api.openstack.wsgi [None req-f3f13d8a-d1c8-4c9a-8857-9bf46ef2794a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Returning 404 to user: Instance 14017978-5ca1-41e3-9cee-2b9fe9d737d3 could not be found. {{(pid=117088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 20 20:15:38.254350 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO nova.api.openstack.requestlog [None req-f3f13d8a-d1c8-4c9a-8857-9bf46ef2794a tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3" status: 404 len: 111 microversion: 2.1 time: 0.028215 Feb 20 20:15:38.255465 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: [pid: 117088|app: 0|req: 585/1164] 10.222.0.60 () {58 vars in 1235 bytes} [Sun Feb 20 20:15:38 2022] GET /compute/v2.1/servers/14017978-5ca1-41e3-9cee-2b9fe9d737d3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 20 20:15:39.784639 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: DEBUG nova.api.openstack.wsgi [None req-d1569d01-1c62-4c45-8601-6fb85de68154 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] Calling method '.version_select at 0x7fdd915ace50>' {{(pid=117087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 20 20:15:39.883731 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO nova.api.openstack.requestlog [None req-d1569d01-1c62-4c45-8601-6fb85de68154 tempest-TestVolumeBootPattern-1561154465 tempest-TestVolumeBootPattern-1561154465-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-640523116" status: 202 len: 0 microversion: 2.1 time: 0.102697 Feb 20 20:15:39.884362 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: [pid: 117087|app: 0|req: 580/1165] 10.222.0.60 () {58 vars in 1259 bytes} [Sun Feb 20 20:15:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-640523116 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 20 20:17:47.060390 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 20 20:17:47.061245 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: Sun Feb 20 20:17:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 20 20:18:51.723903 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 20 20:18:51.725077 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: Sun Feb 20 20:18:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 20 20:19:03.733196 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 20 20:19:03.733786 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: Sun Feb 20 20:19:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 20 20:20:41.428914 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 20 20:20:41.429578 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: Sun Feb 20 20:20:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 20 20:20:49.235552 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 20 20:20:49.236188 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: Sun Feb 20 20:20:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 20 20:21:00.106402 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 20 20:21:00.107005 dv-cinder-830085-1-iscsi devstack@n-api.service[117087]: Sun Feb 20 20:21:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 20 20:21:07.069175 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 20 20:21:07.069712 dv-cinder-830085-1-iscsi devstack@n-api.service[117088]: Sun Feb 20 20:21:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!